Apr 29 08:28:01 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:28:01 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:28:01 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:28:02 devstack cinder-volume[75406]: INFO dbcounter [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Registered counter for database cinder
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG dbcounter [-] [75406] Writer thread running {{(pid=75406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:28:02 devstack cinder-volume[75406]: INFO cinder.rpc [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:28:02 devstack cinder-volume[75406]: INFO cinder.rpc [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:02 devstack cinder-volume[75406]: INFO cinder.volume.manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Determined volume DB was empty at startup.
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG cinder.volume.manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75406) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:28:02 devstack cinder-volume[75406]: INFO cinder.volume.manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 08:28:02 devstack cinder-volume[75406]: WARNING stevedore.named [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:28:02 devstack cinder-volume[75406]: WARNING castellan.key_manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:02 devstack cinder-volume[75406]: WARNING cinder.keymgr.conf_key_mgr [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG cinder.volume.drivers.lvm [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75406) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 29 08:28:02 devstack cinder-volume[75406]: DEBUG oslo_concurrency.processutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_concurrency.processutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] CMD "cinder-rtstool verify" returned: 0 in 0.372s {{(pid=75406) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:03 devstack cinder-volume[75406]: INFO cinder.rpc [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 29 08:28:03 devstack cinder-volume[75406]: INFO cinder.rpc [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 29 08:28:03 devstack cinder-volume[75406]: WARNING stevedore.named [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:28:03 devstack cinder-volume[75406]: WARNING castellan.key_manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:28:03 devstack cinder-volume[75406]: INFO cinder.volume.manager [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75406) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:03 devstack cinder-volume[75406]: INFO oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Starting 1 workers
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Started child 75581 {{(pid=75406) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Full set of CONF: {{(pid=75406) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] ******************************************************************************** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Configuration options gathered from: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] ================================================================================ {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] allow_availability_zone_fallback = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75581]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] allow_compression_on_image_upload = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] allowed_direct_url_schemes     = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] api_rate_limit                 = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] auth_strategy                  = keystone {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] az_cache_duration              = 3600 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_availability_zone      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_host                   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_name                   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_stats_polling_interval = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backup_api_class               = cinder.backup.api.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backup_name_template           = backup-%s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backup_use_same_host           = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backup_use_temp_snapshot       = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] chap_password                  = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] chap_username                  =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_internal_tenant_project_id = da2feecdbb4244fab5e013e54c894394 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_internal_tenant_user_id = 99ef3998d2164d48af406f7a554b8503 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cloned_volume_same_az          = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cluster                        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] compression_format             = gzip {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] config_dir                     = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] config_source                  = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] control_exchange               = openstack {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] debug                          = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] default_availability_zone      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] default_group_type             = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] default_volume_type            = lvmdriver-1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] disk_geometry                  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_client_cert             = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_client_cert_key         = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_data_namespace          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_ssl_cert_path           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_ssl_cert_verify         = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] driver_use_ssl                 = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] enable_force_upload            = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] enable_new_services            = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] enable_unsupported_driver      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] enforce_multipath_for_image_xfer = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] filter_function                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_api_insecure            = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_api_servers             = ['http://192.168.122.230/image'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_api_ssl_compression     = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_ca_certificates_file    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_certfile                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_keyfile                 = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_num_retries             = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance_request_timeout         = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] goodness_function              = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] graceful_shutdown_timeout      = 5 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] group_api_class                = cinder.group.api.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] host                           = devstack {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_compress_on_upload       = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_conversion_address_space_limit = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_conversion_cpu_limit     = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_conversion_disable       = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75581]: INFO cinder.volume.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_upload_use_cinder_backend = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_upload_use_internal_tenant = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_volume_cache_enabled     = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_volume_cache_max_count   = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] image_volume_cache_max_size_gb = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] init_host_max_objects_retrieval = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iscsi_target_flags             =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iscsi_write_cache              = on {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iser_helper                    = tgtadm {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iser_ip_address                = 192.168.122.230 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iser_port                      = 3260 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_color                      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_config_append              = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_dir                        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_file                       = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_options                    = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_rotate_interval            = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_rotate_interval_type       = days {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] log_rotation_type              = none {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] max_age                        = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] max_logfile_count              = 30 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] max_logfile_size_mb            = 200 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] max_over_subscription_ratio    = 20.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] message_reap_interval          = 86400 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] message_ttl                    = 2592000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] migration_create_volume_timeout_secs = 300 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] monkey_patch                   = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] monkey_patch_modules           = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] my_ip                          = 192.168.122.230 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] no_snapshot_gb_quota           = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] num_iser_scan_tries            = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] num_shell_tries                = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] num_volume_device_scan_tries   = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] nvmeof_conn_info_version       = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] nvmet_ns_id                    = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] nvmet_port_id                  = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_max_limit                = 1000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_ext_list          = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_listen_port       = 8776 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_use_ssl           = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] osapi_volume_workers           = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] per_volume_size_limit          = -1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] periodic_fuzzy_delay           = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] periodic_interval              = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] public_endpoint                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] publish_errors                 = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_backup_gigabytes         = 1000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_backups                  = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_gigabytes                = 1000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_groups                   = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_snapshots                = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] quota_volumes                  = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] rate_limit_burst               = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] rate_limit_except_level        = CRITICAL {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] rate_limit_interval            = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] reinit_driver_count            = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] replication_device             = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] report_discard_supported       = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] report_interval                = 120 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] reservation_clean_interval     = 86400 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] reservation_expire             = 86400 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] reserved_image_namespaces      = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] reserved_percentage            = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] rpc_response_timeout           = 120 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] run_external_periodic_tasks    = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] scst_target_driver             = iscsi {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] scst_target_iqn_name           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_down_time              = 720 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] shell_completion               = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] snapshot_name_template         = snapshot-%s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] snapshot_same_host             = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] split_loggers                  = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] state_path                     = /opt/stack/data/cinder {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] storage_availability_zone      = nova {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] storage_protocol               = iSCSI {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] syslog_log_facility            = LOG_USER {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_helper                  = lioadm {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_ip_address              = 192.168.122.230 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_port                    = 3260 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_protocol                = iscsi {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] target_secondary_ip_addresses  = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] trace_flags                    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] transport_url                  = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] until_refresh                  = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_chap_auth                  = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_default_quota_class        = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_journal                    = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_json                       = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_multipath_for_image_xfer   = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_stderr                     = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] use_syslog                     = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] verify_glance_signatures       = enabled {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_api_class               = cinder.volume.api.API {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_backend_name            = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_clear                   = zero {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_clear_ionice            = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_clear_size              = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_copy_bps_limit          = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_dd_blocksize            = 1M {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_name_template           = volume-%s {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_service_inithost_offload = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volume_usage_audit_period      = month {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] zoning_mode                    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_concurrency.disable_process_locking = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.admin_password = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.admin_token = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.admin_user  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_protocol = https {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_section = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_type   = password {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_uri    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.auth_version = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.cache       = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.certfile    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.identity_uri = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.include_service_catalog = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.insecure    = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.interface   = public {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.keyfile     = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_password =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcache_username =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.region_name = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.service_type = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.backend                  = dogpile.cache.null {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.backend_argument         = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.backend_expiration_time  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.config_prefix            = cache.oslo {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.debug_cache_backend      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.enable_retry_client      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.enable_socket_keepalive  = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.enabled                  = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.enforce_fips_mode        = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.expiration_time          = 600 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.hashclient_retry_attempts = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_dead_retry      = 300 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_sasl_enabled    = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.password                 = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.proxies                  = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.redis_db                 = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack sudo[75585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.redis_server             = localhost:6379 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.retry_attempts           = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.retry_delay              = 0.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.socket_keepalive_count   = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.socket_keepalive_idle    = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.socket_keepalive_interval = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack sudo[75585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.socket_timeout           = 1.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.tls_allowed_ciphers      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.tls_cafile               = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.tls_certfile             = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.tls_enabled              = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.tls_keyfile              = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cache.username                 = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] coordination.backend_url       = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.asyncio_connection    = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.asyncio_slave_connection = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.backend               = sqlalchemy {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.connection            = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.connection_debug      = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.connection_parameters =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.connection_recycle_time = 3600 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.connection_trace      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.db_inc_retry_interval = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.db_max_retries        = 20 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.db_max_retry_interval = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.db_retry_interval     = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.max_overflow          = 50 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.max_pool_size         = 5 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.max_retries           = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.mysql_wsrep_sync_wait = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.pool_timeout          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.retry_interval        = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.slave_connection      = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.sqlite_synchronous    = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.synchronous_reader    = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] database.use_db_reconnect      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.connection_string     = messaging:// {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.enabled               = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.es_doc_type           = notification {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.es_scroll_size        = 10000 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.es_scroll_time        = 2m {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.filter_error_trace    = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.hmac_keys             = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.sentinel_service_name = mymaster {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.socket_timeout        = 0.1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.trace_requests        = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler.trace_sqlalchemy      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler_jaeger.process_tags   = {} {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler_jaeger.service_name_prefix = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] profiler_otlp.service_name_prefix = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.enforce_new_defaults = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: WARNING oslo_config.cfg [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.enforce_scope      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.policy_default_rule = default {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.group          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.helper_command = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] privsep_osbrick.user           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.group         = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.helper_command = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] cinder_sys_admin.user          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.auth_section      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.auth_type         = password {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.cafile            = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.certfile          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.collect_timing    = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.insecure          = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.keyfile           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.send_service_user_token = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.split_loggers     = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] service_user.timeout           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.auth_section            = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.auth_type               = password {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.certfile                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.collect_timing          = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.insecure                = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.keyfile                 = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.region_name             = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.split_loggers           = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] glance.timeout                 = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.backend_availability_zone = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.chap_password = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.chap_username =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.disk_geometry = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_client_cert = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_client_cert_key = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_data_namespace = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.driver_use_ssl = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.extra_capabilities = {} {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.filter_function = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.goodness_function = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iscsi_target_flags =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iscsi_write_cache = on {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iser_port     = 3260 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.lvm_share_target = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.lvm_type      = auto {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.num_shell_tries = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.replication_device = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.report_discard_supported = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.reserved_percentage = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_helper = tgtadm {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_port   = 3260 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_protocol = iscsi {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.trace_flags   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.unique_fqdn_network = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.use_chap_auth = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_backend_name = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_clear  = zero {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_clear_ionice = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_clear_size = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_reports.file_event_handler = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_reports.log_dir           = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.backend_host       = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.chap_password      = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.chap_username      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.disk_geometry      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_client_cert = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.extra_capabilities = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.filter_function    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.goodness_function  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iser_helper        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iser_port          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.lvm_type           = auto {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.replication_device = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.report_discard_supported = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.reserved_percentage = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.scst_target_driver = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.storage_protocol   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_ip_address  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_port        = 3260 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.trace_flags        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_clear       = zero {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] lvmdriver-1.volumes_dir        = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_notifications.driver = [] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_notifications.retry = -1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] key_manager.fixed_key          = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.barbican_api_version  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.barbican_endpoint     = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.barbican_endpoint_type = public {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.barbican_region_name  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.cafile                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.certfile              = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.collect_timing        = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.insecure              = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.keyfile               = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.number_of_retries     = 60 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.retry_delay           = 1 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.send_service_user_token = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.split_loggers         = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.timeout               = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.verify_ssl            = True {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican.verify_ssl_path       = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.auth_section = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.auth_type = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.cafile   = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.certfile = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.collect_timing = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.insecure = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.keyfile  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.split_loggers = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] barbican_service_user.timeout  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.approle_role_id          = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.approle_secret_id        = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.kv_mountpoint            = secret {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.kv_path                  = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.kv_version               = 2 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.namespace                = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.root_token_id            = **** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.ssl_ca_crt_file          = None {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.timeout                  = 60.0 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.use_ssl                  = False {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:28:03 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] ******************************************************************************** {{(pid=75406) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.870s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:04 devstack sudo[75585]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:04 devstack sudo[75741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:04 devstack sudo[75741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:04 devstack sudo[75741]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.672s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:28:04 devstack cinder-volume[75581]: INFO cinder.brick.local_dev.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:04 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:04 devstack sudo[75941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:04 devstack sudo[75941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:05 devstack sudo[75941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:05 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:05 devstack cinder-volume[75581]: DEBUG cinder.brick.local_dev.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75581) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 29 08:28:05 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:05 devstack sudo[76148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:05 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:06 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:06 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.047s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:06 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:06 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:06 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:06 devstack sudo[76323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:06 devstack sudo[76323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:07 devstack sudo[76323]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:07 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:07 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:07 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:07 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:07 devstack sudo[76360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 29 08:28:07 devstack sudo[76360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:08 devstack sudo[76360]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:08 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.897s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:08 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:08 devstack sudo[76364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:08 devstack sudo[76364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:09 devstack sudo[76364]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:09 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:09 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:09 devstack sudo[76375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:09 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:09 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:09 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:09 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:09 devstack sudo[76379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:09 devstack sudo[76379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:10 devstack sudo[76379]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:10 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:10 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:10 devstack sudo[76384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:10 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:11 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:11 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.891s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:11 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:11 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:11 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:11 devstack sudo[76395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:11 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:12 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.843s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:12 devstack cinder-volume[75581]: INFO cinder.volume.drivers.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:12 devstack sudo[76489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:12 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:12 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.736s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG cinder.volume.drivers.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Updating volume stats {{(pid=75581) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:12 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:12 devstack sudo[76521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:12 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:13 devstack cinder-volume[75406]: DEBUG dbcounter [-] [75406] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75406) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:28:13 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:13 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:13 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:13 devstack sudo[76662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:13 devstack sudo[76662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:14 devstack sudo[76662]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:14 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:14 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:14 devstack sudo[76666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:14 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:14 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:14 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:14 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:14 devstack sudo[76669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:14 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:15 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:15 devstack cinder-volume[75581]: INFO cinder.volume.driver [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG cinder.volume.driver [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75581) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG oslo_db.sqlalchemy.engines [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75581) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG dbcounter [-] [75581] Writer thread running {{(pid=75581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG cinder.db.sqlalchemy.api [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Building query based on filter {{(pid=75581) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG cinder.image.image_utils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75581) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:28:15 devstack cinder-volume[75581]: INFO cinder.keymgr.migration [None req-e90dda2e-2e9d-4701-902e-558a07de050d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG cinder.volume.drivers.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Updating volume stats {{(pid=75581) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:15 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:15 devstack sudo[76676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:15 devstack sudo[76676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:16 devstack sudo[76676]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:16 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.572s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:16 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:16 devstack sudo[76680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:16 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:16 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:16 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:16 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:16 devstack sudo[76683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:16 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:17 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:17 devstack sudo[76687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:17 devstack sudo[76687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:17 devstack sudo[76687]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG cinder.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Notifying Schedulers of capabilities ... {{(pid=75581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:28:17 devstack cinder-volume[75581]: INFO cinder.volume.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Driver initialization completed successfully.
Apr 29 08:28:17 devstack cinder-volume[75581]: INFO cinder.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Initiating service 2 cleanup
Apr 29 08:28:17 devstack cinder-volume[75581]: INFO cinder.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Service 2 cleanup completed.
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG cinder.service [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Creating RPC server for service cinder-volume {{(pid=75581) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:28:17 devstack cinder-volume[75581]: DEBUG cinder.service [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75581) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:28:18 devstack cinder-volume[75581]: INFO cinder.volume.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 29 08:28:18 devstack cinder-volume[75581]: DEBUG cinder.volume.drivers.lvm [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Updating volume stats {{(pid=75581) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:28:18 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:18 devstack sudo[76694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:28:18 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:18 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:18 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:18 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:18 devstack sudo[76698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:18 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:19 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:19 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:19 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:19 devstack sudo[76702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:28:19 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:20 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:20 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.582s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:20 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:28:20 devstack sudo[76759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:28:20 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:28:20 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root
Apr 29 08:28:20 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:28:20 devstack cinder-volume[75581]: INFO cinder.volume.manager [None req-e2a8539b-8f68-43af-84a0-844875279036 None None] Driver post RPC initialization completed successfully.
Apr 29 08:28:30 devstack cinder-volume[75581]: DEBUG dbcounter [-] [75581] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:28:30 devstack cinder-volume[75581]: DEBUG dbcounter [-] [75581] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:29:46 devstack cinder-volume[75581]: DEBUG oslo_service.periodic_task [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:29:46 devstack cinder-volume[75581]: DEBUG cinder.volume.drivers.lvm [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Updating volume stats {{(pid=75581) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:29:46 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:29:46 devstack sudo[81463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:29:46 devstack sudo[81463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:29:47 devstack sudo[81463]: pam_unix(sudo:session): session closed for user root
Apr 29 08:29:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:29:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:29:47 devstack sudo[81468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:29:47 devstack sudo[81468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:29:47 devstack sudo[81468]: pam_unix(sudo:session): session closed for user root
Apr 29 08:29:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:29:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:29:47 devstack sudo[81471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:29:47 devstack sudo[81471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:29:48 devstack sudo[81471]: pam_unix(sudo:session): session closed for user root
Apr 29 08:29:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:29:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:29:48 devstack sudo[81474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:29:48 devstack sudo[81474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:29:48 devstack sudo[81474]: pam_unix(sudo:session): session closed for user root
Apr 29 08:29:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.581s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:29:48 devstack cinder-volume[75581]: DEBUG cinder.manager [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Notifying Schedulers of capabilities ... {{(pid=75581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:30:30 devstack cinder-volume[75581]: DEBUG dbcounter [-] [75581] Writing DB stats cinder:SELECT=1 {{(pid=75581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:30:30 devstack cinder-volume[75581]: DEBUG dbcounter [-] [75581] Writing DB stats cinder:UPDATE=1 {{(pid=75581) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:30:46 devstack cinder-volume[75581]: DEBUG oslo_service.periodic_task [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75581) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:30:46 devstack cinder-volume[75581]: DEBUG cinder.volume.drivers.lvm [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Updating volume stats {{(pid=75581) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 08:30:46 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:46 devstack sudo[81902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 08:30:46 devstack sudo[81902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:47 devstack sudo[81902]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:47 devstack sudo[81942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:30:47 devstack sudo[81942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:47 devstack sudo[81942]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:47 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:47 devstack sudo[81957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 08:30:47 devstack sudo[81957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:48 devstack sudo[81957]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.566s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:30:48 devstack sudo[81960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 08:30:48 devstack sudo[81960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:30:48 devstack sudo[81960]: pam_unix(sudo:session): session closed for user root
Apr 29 08:30:48 devstack cinder-volume[75581]: DEBUG oslo_concurrency.processutils [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=75581) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:30:48 devstack cinder-volume[75581]: DEBUG cinder.manager [None req-6b2882bd-6223-4bab-9a01-757ce4d61f4f None None] Notifying Schedulers of capabilities ... {{(pid=75581) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:08 devstack cinder-volume[75406]: INFO oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Caught SIGTERM, stopping children
Apr 29 08:31:08 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Acquiring lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:08 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Acquired lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:08 devstack cinder-volume[75406]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Releasing lock "singleton_lock" {{(pid=75406) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:08 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Stop services. {{(pid=75406) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 08:31:08 devstack cinder-volume[75406]: DEBUG oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Killing children. {{(pid=75406) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 08:31:08 devstack cinder-volume[75406]: INFO oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Waiting on 1 children to exit
Apr 29 08:31:13 devstack cinder-volume[75581]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Acquiring lock "singleton_lock" {{(pid=75581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:13 devstack cinder-volume[75581]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Acquired lock "singleton_lock" {{(pid=75581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:13 devstack cinder-volume[75581]: DEBUG oslo_concurrency.lockutils [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Releasing lock "singleton_lock" {{(pid=75581) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:13 devstack cinder-volume[75581]: WARNING amqp [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:13 devstack cinder-volume[75581]: WARNING amqp [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:13 devstack cinder-volume[75406]: INFO oslo_service.backend._eventlet.service [None req-6aa59dce-b366-4f34-99ed-325f02f36255 None None] Child 75581 exited with status 0
Apr 29 08:31:15 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:15 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:15 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:16 devstack cinder-volume[83266]: INFO dbcounter [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Registered counter for database cinder
Apr 29 08:31:16 devstack cinder-volume[83266]: DEBUG oslo_db.sqlalchemy.engines [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:16 devstack cinder-volume[83266]: DEBUG dbcounter [-] [83266] Writer thread running {{(pid=83266) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:16 devstack cinder-volume[83266]: INFO cinder.rpc [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:31:16 devstack cinder-volume[83266]: INFO cinder.rpc [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:31:16 devstack cinder-volume[83266]: DEBUG oslo_db.sqlalchemy.engines [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:16 devstack cinder-volume[83266]: INFO cinder.volume.manager [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Determined volume DB was empty at startup.
Apr 29 08:31:16 devstack cinder-volume[83266]: DEBUG cinder.volume.manager [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83266) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:31:16 devstack cinder-volume[83266]: INFO cinder.volume.manager [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 08:31:16 devstack cinder-volume[83266]: WARNING stevedore.named [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:31:16 devstack cinder-volume[83266]: WARNING castellan.key_manager [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:16 devstack cinder-volume[83266]: WARNING cinder.keymgr.conf_key_mgr [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:17 devstack cinder-volume[83266]: INFO cinder.volume.manager [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_db.sqlalchemy.engines [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:17 devstack cinder-volume[83266]: INFO oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Starting 1 workers
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Started child 83564 {{(pid=83266) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Full set of CONF: {{(pid=83266) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] ******************************************************************************** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Configuration options gathered from: {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] ================================================================================ {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] allow_availability_zone_fallback = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] allow_compression_on_image_upload = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] allowed_direct_url_schemes     = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] api_rate_limit                 = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83564]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] auth_strategy                  = keystone {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_availability_zone      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_host                   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_name                   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_stats_polling_interval = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backup_api_class               = cinder.backup.api.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backup_name_template           = backup-%s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backup_use_same_host           = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backup_use_temp_snapshot       = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] chap_password                  = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] chap_username                  =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_internal_tenant_project_id = da2feecdbb4244fab5e013e54c894394 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_internal_tenant_user_id = 99ef3998d2164d48af406f7a554b8503 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cluster                        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] compression_format             = gzip {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] config_dir                     = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] config_source                  = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] control_exchange               = openstack {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] debug                          = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] default_availability_zone      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] default_group_type             = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] default_volume_type            = QuobyteHD {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] disk_geometry                  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_client_cert             = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_client_cert_key         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_data_namespace          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_ssl_cert_path           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_ssl_cert_verify         = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] driver_use_ssl                 = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] enable_new_services            = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] enable_unsupported_driver      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] enforce_multipath_for_image_xfer = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] filter_function                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_api_insecure            = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_api_servers             = ['http://192.168.122.230/image'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_api_ssl_compression     = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_ca_certificates_file    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_certfile                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_keyfile                 = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_num_retries             = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance_request_timeout         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] goodness_function              = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] graceful_shutdown_timeout      = 5 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] group_api_class                = cinder.group.api.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] host                           = devstack {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_compress_on_upload       = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_conversion_address_space_limit = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_conversion_cpu_limit     = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_conversion_disable       = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_upload_use_cinder_backend = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_upload_use_internal_tenant = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_volume_cache_enabled     = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_volume_cache_max_count   = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] image_volume_cache_max_size_gb = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] init_host_max_objects_retrieval = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83564]: INFO cinder.volume.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iscsi_target_flags             =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iscsi_write_cache              = on {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.remotefs [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83564) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iser_helper                    = tgtadm {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iser_ip_address                = 192.168.122.230 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iser_port                      = 3260 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_color                      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_config_append              = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_dir                        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_file                       = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_options                    = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_rotate_interval            = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_rotate_interval_type       = days {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] log_rotation_type              = none {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] max_age                        = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] max_logfile_count              = 30 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] max_logfile_size_mb            = 200 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] max_over_subscription_ratio    = 20.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] message_reap_interval          = 86400 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] message_ttl                    = 2592000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] migration_create_volume_timeout_secs = 300 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] monkey_patch                   = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] monkey_patch_modules           = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] my_ip                          = 192.168.122.230 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] no_snapshot_gb_quota           = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] num_iser_scan_tries            = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] num_shell_tries                = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] num_volume_device_scan_tries   = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] nvmeof_conn_info_version       = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] nvmet_ns_id                    = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] nvmet_port_id                  = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_max_limit                = 1000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_ext_list          = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_listen_port       = 8776 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_use_ssl           = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] osapi_volume_workers           = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] per_volume_size_limit          = -1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] periodic_fuzzy_delay           = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] periodic_interval              = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] public_endpoint                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] publish_errors                 = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_backup_gigabytes         = 1000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_backups                  = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_gigabytes                = 1000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_groups                   = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_snapshots                = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] quota_volumes                  = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] rate_limit_burst               = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] rate_limit_except_level        = CRITICAL {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] rate_limit_interval            = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] reinit_driver_count            = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] replication_device             = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] report_discard_supported       = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] report_interval                = 120 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] reservation_clean_interval     = 86400 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] reservation_expire             = 86400 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] reserved_image_namespaces      = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] reserved_percentage            = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] rpc_response_timeout           = 120 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] run_external_periodic_tasks    = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] scst_target_driver             = iscsi {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] scst_target_iqn_name           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_down_time              = 720 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] shell_completion               = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] snapshot_name_template         = snapshot-%s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] split_loggers                  = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] state_path                     = /opt/stack/data/cinder {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] storage_availability_zone      = nova {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] storage_protocol               = iSCSI {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] syslog_log_facility            = LOG_USER {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_helper                  = lioadm {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_ip_address              = 192.168.122.230 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_port                    = 3260 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_protocol                = iscsi {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] target_secondary_ip_addresses  = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] trace_flags                    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] transport_url                  = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] until_refresh                  = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_chap_auth                  = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_default_quota_class        = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_journal                    = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_json                       = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_multipath_for_image_xfer   = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_stderr                     = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] use_syslog                     = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] verify_glance_signatures       = enabled {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_api_class               = cinder.volume.api.API {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_backend_name            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_clear                   = zero {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_clear_ionice            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_clear_size              = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_copy_bps_limit          = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_dd_blocksize            = 1M {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_name_template           = volume-%s {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_service_inithost_offload = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volume_usage_audit_period      = month {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] zoning_mode                    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_concurrency.disable_process_locking = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.admin_password = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.admin_token = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.admin_user  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_protocol = https {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_section = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_type   = password {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_uri    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.auth_version = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.cache       = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.certfile    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.identity_uri = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.include_service_catalog = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.insecure    = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.interface   = public {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.keyfile     = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_password =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcache_username =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.region_name = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.service_type = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.backend                  = dogpile.cache.null {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.backend_argument         = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.backend_expiration_time  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.config_prefix            = cache.oslo {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.debug_cache_backend      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.enable_retry_client      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.enable_socket_keepalive  = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.enabled                  = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.enforce_fips_mode        = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.expiration_time          = 600 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.hashclient_retry_attempts = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_dead_retry      = 300 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_sasl_enabled    = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.password                 = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.proxies                  = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.redis_db                 = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.redis_server             = localhost:6379 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.retry_attempts           = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.retry_delay              = 0.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.socket_keepalive_count   = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.socket_keepalive_idle    = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.socket_keepalive_interval = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.socket_timeout           = 1.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.tls_allowed_ciphers      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.tls_cafile               = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.tls_certfile             = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83564) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 08:31:17 devstack cinder-volume[83564]: WARNING cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 08:31:17 devstack cinder-volume[83564]: WARNING cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.tls_enabled              = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.tls_keyfile              = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cache.username                 = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] coordination.backend_url       = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.asyncio_connection    = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.asyncio_slave_connection = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.backend               = sqlalchemy {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Running cmd (subprocess): mount.quobyte {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.connection            = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.connection_debug      = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.connection_parameters =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.connection_recycle_time = 3600 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.connection_trace      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.db_inc_retry_interval = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.db_max_retries        = 20 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.db_max_retry_interval = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.db_retry_interval     = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.max_overflow          = 50 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.max_pool_size         = 5 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.max_retries           = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.mysql_wsrep_sync_wait = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.pool_timeout          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.retry_interval        = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.slave_connection      = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.sqlite_synchronous    = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.synchronous_reader    = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] database.use_db_reconnect      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.connection_string     = messaging:// {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.enabled               = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.es_doc_type           = notification {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.es_scroll_size        = 10000 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.es_scroll_time        = 2m {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.filter_error_trace    = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.hmac_keys             = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.sentinel_service_name = mymaster {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.socket_timeout        = 0.1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.trace_requests        = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler.trace_sqlalchemy      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler_jaeger.process_tags   = {} {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler_jaeger.service_name_prefix = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] profiler_otlp.service_name_prefix = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.enforce_new_defaults = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: WARNING oslo_config.cfg [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.enforce_scope      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.policy_default_rule = default {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.group          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.helper_command = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] privsep_osbrick.user           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.group         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.helper_command = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] cinder_sys_admin.user          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.auth_section      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.auth_type         = password {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.cafile            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.certfile          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.collect_timing    = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.insecure          = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.keyfile           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.send_service_user_token = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.split_loggers     = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] service_user.timeout           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.auth_section            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.auth_type               = password {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.certfile                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.collect_timing          = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.insecure                = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.keyfile                 = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.region_name             = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.split_loggers           = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] glance.timeout                 = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.backend_availability_zone = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.chap_password = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.chap_username =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.disk_geometry = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_client_cert = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_client_cert_key = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_data_namespace = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.driver_use_ssl = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.extra_capabilities = {} {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.filter_function = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.goodness_function = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iscsi_target_flags =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iscsi_write_cache = on {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iser_port     = 3260 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_host      =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_login     = admin {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_mount_options = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_password  = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_private_key =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_share_path =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.num_shell_tries = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.quobyte_volume_url = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.replication_device = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.report_discard_supported = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.reserved_percentage = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_helper = tgtadm {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_port   = 3260 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_protocol = iscsi {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.trace_flags   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.unique_fqdn_network = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.use_chap_auth = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_backend_name = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_clear  = zero {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_clear_ionice = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_clear_size = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_reports.file_event_handler = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_reports.log_dir           = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.backend_availability_zone = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.backend_host         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.chap_password        = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.chap_username        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.disk_geometry        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_client_cert   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_data_namespace = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.extra_capabilities   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack quobyte-client[83571]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.filter_function      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.goodness_function    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack quobyte-client[83571]: Invalid parameters found, error: missing mount point.
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack quobyte-client[83571]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:17 devstack quobyte-client[83571]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iser_helper          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iser_ip_address      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iser_port            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_host             = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=83564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_login            = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_mount_options    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: INFO cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 ...
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_password         = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_private_key      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 -c /etc/quobyte/client-cinder.cfg {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_share_path       = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.num_shell_tries      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.replication_device   = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.report_discard_supported = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.reserved_percentage  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.scst_target_driver   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.storage_protocol     = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_helper        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_ip_address    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_port          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_prefix        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_protocol      = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.trace_flags          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.use_chap_auth        = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_clear         = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_clear_size    = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] QuobyteHD.volumes_dir          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_notifications.driver = [] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_notifications.retry = -1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] key_manager.fixed_key          = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.barbican_api_version  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.barbican_endpoint     = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.barbican_endpoint_type = public {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.barbican_region_name  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.cafile                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.certfile              = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.collect_timing        = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.insecure              = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack sudo[83581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 -c /etc/quobyte/client-cinder.cfg
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.keyfile               = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.number_of_retries     = 60 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.retry_delay           = 1 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.send_service_user_token = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.split_loggers         = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.timeout               = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.verify_ssl            = True {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack sudo[83581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican.verify_ssl_path       = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.auth_section = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.auth_type = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.cafile   = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.certfile = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.collect_timing = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.insecure = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.keyfile  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.split_loggers = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] barbican_service_user.timeout  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.approle_role_id          = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.approle_secret_id        = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.kv_mountpoint            = secret {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.kv_path                  = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.kv_version               = 2 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.namespace                = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.root_token_id            = **** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.ssl_ca_crt_file          = None {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.timeout                  = 60.0 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.use_ssl                  = False {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:17 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] ******************************************************************************** {{(pid=83266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:31:18 devstack sudo[83581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.829s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:18 devstack cinder-volume[83564]: INFO cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 succeeded
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=83564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.846s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:18 devstack sudo[83654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:18 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:18 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.604s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:18 devstack cinder-volume[83564]: INFO cinder.volume.driver [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG cinder.volume.driver [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83564) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:31:18 devstack cinder-volume[83564]: DEBUG oslo_db.sqlalchemy.engines [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83564) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG dbcounter [-] [83564] Writer thread running {{(pid=83564) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.db.sqlalchemy.api [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Building query based on filter {{(pid=83564) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.image.image_utils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83564) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:31:19 devstack cinder-volume[83564]: INFO cinder.keymgr.migration [None req-3525ce1e-f02a-462e-9c69-94519ad13651 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=83564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=83564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:19 devstack sudo[83657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:19 devstack sudo[83657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:19 devstack sudo[83657]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.579s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Notifying Schedulers of capabilities ... {{(pid=83564) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:19 devstack cinder-volume[83564]: INFO cinder.volume.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Driver initialization completed successfully.
Apr 29 08:31:19 devstack cinder-volume[83564]: INFO cinder.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Initiating service 3 cleanup
Apr 29 08:31:19 devstack cinder-volume[83564]: INFO cinder.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Service 3 cleanup completed.
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.service [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Creating RPC server for service cinder-volume {{(pid=83564) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.service [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83564) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:31:19 devstack cinder-volume[83564]: INFO cinder.volume.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=83564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=83564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:19 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:19 devstack sudo[83665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:19 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:20 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:20 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.711s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:20 devstack cinder-volume[83564]: INFO cinder.volume.manager [None req-cf681b6a-e7d3-49a0-9b0e-d092cfc94ad9 None None] Driver post RPC initialization completed successfully.
Apr 29 08:31:24 devstack cinder-volume[83266]: INFO oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Caught SIGTERM, stopping children
Apr 29 08:31:24 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Acquiring lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:24 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Acquired lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:24 devstack cinder-volume[83266]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Releasing lock "singleton_lock" {{(pid=83266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:24 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Stop services. {{(pid=83266) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 08:31:24 devstack cinder-volume[83266]: DEBUG oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Killing children. {{(pid=83266) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 08:31:24 devstack cinder-volume[83266]: INFO oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Waiting on 1 children to exit
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=83564) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG cinder.volume.drivers.quobyte [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=83564) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83564) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:24 devstack sudo[83835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:24 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:24 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG oslo_concurrency.processutils [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.705s {{(pid=83564) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:24 devstack cinder-volume[83564]: DEBUG cinder.manager [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Notifying Schedulers of capabilities ... {{(pid=83564) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:24 devstack cinder-volume[83564]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:24 devstack cinder-volume[83564]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Unable to connect to AMQP server on 192.168.122.230:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server [None req-3ba5c060-5bf0-4b9b-99da-68f259b0b3cd None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.230:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     method()
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return _publish(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     listener(*args)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self.transport._send(self.target, msg_ctxt, msg,
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.230:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Apr 29 08:31:25 devstack cinder-volume[83564]: ERROR oslo_messaging.rpc.server 
Apr 29 08:31:28 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Acquiring lock "singleton_lock" {{(pid=83564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:28 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Acquired lock "singleton_lock" {{(pid=83564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:28 devstack cinder-volume[83564]: DEBUG oslo_concurrency.lockutils [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Releasing lock "singleton_lock" {{(pid=83564) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:28 devstack cinder-volume[83564]: WARNING amqp [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:28 devstack cinder-volume[83564]: WARNING amqp [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 08:31:28 devstack cinder-volume[83266]: INFO oslo_service.backend._eventlet.service [None req-87fd0e8a-b022-4014-90dc-86e85eccd793 None None] Child 83564 exited with status 0
Apr 29 08:31:31 devstack cinder-volume[83848]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 08:31:31 devstack cinder-volume[83848]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 08:31:31 devstack cinder-volume[83848]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 08:31:31 devstack cinder-volume[83848]: INFO dbcounter [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Registered counter for database cinder
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_db.sqlalchemy.engines [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG dbcounter [-] [83848] Writer thread running {{(pid=83848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:32 devstack cinder-volume[83848]: INFO cinder.rpc [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 08:31:32 devstack cinder-volume[83848]: INFO cinder.rpc [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_db.sqlalchemy.engines [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:32 devstack cinder-volume[83848]: INFO cinder.volume.manager [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Determined volume DB was empty at startup.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG cinder.volume.manager [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83848) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 08:31:32 devstack cinder-volume[83848]: WARNING stevedore.named [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 08:31:32 devstack cinder-volume[83848]: WARNING castellan.key_manager [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:32 devstack cinder-volume[83848]: WARNING cinder.keymgr.conf_key_mgr [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 08:31:32 devstack cinder-volume[83848]: INFO cinder.volume.manager [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_db.sqlalchemy.engines [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:32 devstack cinder-volume[83848]: INFO oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Starting 1 workers
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Started child 84102 {{(pid=83848) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Full set of CONF: {{(pid=83848) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] ******************************************************************************** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Configuration options gathered from: {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] ================================================================================ {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] allow_availability_zone_fallback = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] allow_compression_on_image_upload = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] allowed_direct_url_schemes     = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] api_rate_limit                 = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] auth_strategy                  = keystone {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_availability_zone      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_host                   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_name                   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[84102]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_stats_polling_interval = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backup_api_class               = cinder.backup.api.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backup_name_template           = backup-%s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backup_use_same_host           = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backup_use_temp_snapshot       = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] chap_password                  = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] chap_username                  =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_internal_tenant_project_id = da2feecdbb4244fab5e013e54c894394 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_internal_tenant_user_id = 99ef3998d2164d48af406f7a554b8503 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cluster                        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] compression_format             = gzip {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] compute_api_class              = cinder.compute.nova.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] config_dir                     = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] config_source                  = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] control_exchange               = openstack {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] debug                          = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] default_availability_zone      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] default_group_type             = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] default_volume_type            = QuobyteHD {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] disk_geometry                  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_client_cert             = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_client_cert_key         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_data_namespace          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_ssl_cert_path           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_ssl_cert_verify         = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] driver_use_ssl                 = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] enable_new_services            = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] enable_unsupported_driver      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] enabled_backends               = ['QuobyteHD'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] enforce_multipath_for_image_xfer = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] filter_function                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_api_insecure            = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_api_servers             = ['http://192.168.122.230/image'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_api_ssl_compression     = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_ca_certificates_file    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_catalog_info            = image:glance:publicURL {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_certfile                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_keyfile                 = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_num_retries             = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance_request_timeout         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] goodness_function              = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] graceful_shutdown_timeout      = 5 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] group_api_class                = cinder.group.api.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] host                           = devstack {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_compress_on_upload       = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_conversion_address_space_limit = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_conversion_cpu_limit     = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_conversion_disable       = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_upload_use_cinder_backend = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_upload_use_internal_tenant = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_volume_cache_enabled     = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_volume_cache_max_count   = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] image_volume_cache_max_size_gb = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] init_host_max_objects_retrieval = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] instance_format                = [instance: %(uuid)s]  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iscsi_target_flags             =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iscsi_write_cache              = on {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iser_helper                    = tgtadm {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iser_ip_address                = 192.168.122.230 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iser_port                      = 3260 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_color                      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_config_append              = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_dir                        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_file                       = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_options                    = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_rotate_interval            = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_rotate_interval_type       = days {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] log_rotation_type              = none {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] max_age                        = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] max_logfile_count              = 30 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] max_logfile_size_mb            = 200 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] max_over_subscription_ratio    = 20.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] message_reap_interval          = 86400 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] message_ttl                    = 2592000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] migration_create_volume_timeout_secs = 300 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] monkey_patch                   = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] monkey_patch_modules           = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] my_ip                          = 192.168.122.230 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] no_snapshot_gb_quota           = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] num_iser_scan_tries            = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] num_shell_tries                = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84102) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] num_volume_device_scan_tries   = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] nvmeof_conn_info_version       = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] nvmet_ns_id                    = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] nvmet_port_id                  = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_max_limit                = 1000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_ext_list          = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_listen_port       = 8776 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_use_ssl           = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] osapi_volume_workers           = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] per_volume_size_limit          = -1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] periodic_fuzzy_delay           = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] periodic_interval              = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] public_endpoint                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] publish_errors                 = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_backup_gigabytes         = 1000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_backups                  = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_gigabytes                = 1000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_groups                   = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_snapshots                = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] quota_volumes                  = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] rate_limit_burst               = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] rate_limit_except_level        = CRITICAL {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] rate_limit_interval            = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] reinit_driver_count            = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] replication_device             = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] report_discard_supported       = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] report_interval                = 120 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] reservation_clean_interval     = 86400 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] reservation_expire             = 86400 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] reserved_image_namespaces      = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] reserved_percentage            = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] rpc_response_timeout           = 120 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] run_external_periodic_tasks    = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] scst_target_driver             = iscsi {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] scst_target_iqn_name           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_down_time              = 720 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] shell_completion               = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] snapshot_name_template         = snapshot-%s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] split_loggers                  = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] state_path                     = /opt/stack/data/cinder {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] storage_availability_zone      = nova {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] storage_protocol               = iSCSI {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] syslog_log_facility            = LOG_USER {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_helper                  = lioadm {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_ip_address              = 192.168.122.230 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_port                    = 3260 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack quobyte-client[84103]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_protocol                = iscsi {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] target_secondary_ip_addresses  = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] trace_flags                    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] transport_url                  = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] until_refresh                  = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_chap_auth                  = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack quobyte-client[84103]: Invalid parameters found, error: missing mount point.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_default_quota_class        = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_journal                    = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_json                       = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_multipath_for_image_xfer   = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_stderr                     = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] use_syslog                     = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] verify_glance_signatures       = enabled {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack quobyte-client[84103]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_api_class               = cinder.volume.api.API {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_backend_name            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_clear                   = zero {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_clear_ionice            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_clear_size              = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack quobyte-client[84103]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_copy_bps_limit          = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_dd_blocksize            = 1M {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_name_template           = volume-%s {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_service_inithost_offload = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volume_usage_audit_period      = month {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] zoning_mode                    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_concurrency.disable_process_locking = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.admin_password = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.admin_token = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.admin_user  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_port   = 35357 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_protocol = https {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_section = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_type   = password {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_uri    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.auth_version = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.cache       = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.certfile    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.delay_auth_decision = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.http_connect_timeout = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.identity_uri = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.include_service_catalog = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.insecure    = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.interface   = public {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.keyfile     = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_password =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcache_username =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.region_name = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.service_token_roles_required = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.service_type = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.token_cache_time = 300 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.230/identity {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.backend                  = dogpile.cache.null {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.backend_argument         = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.backend_expiration_time  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.config_prefix            = cache.oslo {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.debug_cache_backend      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.enable_retry_client      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.enable_socket_keepalive  = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.enabled                  = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.enforce_fips_mode        = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.expiration_time          = 600 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack sudo[84104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.hashclient_retry_attempts = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_dead_retry      = 300 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_pool_maxsize    = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_sasl_enabled    = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.password                 = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.proxies                  = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.redis_db                 = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.redis_sentinel_service_name = mymaster {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.redis_server             = localhost:6379 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.retry_attempts           = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.retry_delay              = 0.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.socket_keepalive_count   = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.socket_keepalive_idle    = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.socket_keepalive_interval = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.socket_timeout           = 1.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.tls_allowed_ciphers      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.tls_cafile               = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.tls_certfile             = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.tls_enabled              = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.tls_keyfile              = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cache.username                 = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] coordination.backend_url       = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.asyncio_connection    = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.asyncio_slave_connection = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.backend               = sqlalchemy {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.connection            = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.connection_debug      = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.connection_parameters =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.connection_recycle_time = 3600 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.connection_trace      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.db_inc_retry_interval = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.db_max_retries        = 20 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.db_max_retry_interval = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.db_retry_interval     = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.max_overflow          = 50 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.max_pool_size         = 5 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.max_retries           = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.mysql_wsrep_sync_wait = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.pool_timeout          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.retry_interval        = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.slave_connection      = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.sqlite_synchronous    = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.synchronous_reader    = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] database.use_db_reconnect      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.connection_string     = messaging:// {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.enabled               = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.es_doc_type           = notification {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.es_scroll_size        = 10000 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.es_scroll_time        = 2m {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.filter_error_trace    = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.hmac_keys             = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.sentinel_service_name = mymaster {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.socket_timeout        = 0.1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.trace_requests        = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler.trace_sqlalchemy      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler_jaeger.process_tags   = {} {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler_jaeger.service_name_prefix = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] profiler_otlp.service_name_prefix = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.enforce_new_defaults = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: WARNING oslo_config.cfg [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.enforce_scope      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.policy_default_rule = default {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.policy_file        = policy.yaml {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.group          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.helper_command = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84102) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] privsep_osbrick.user           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.group         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.helper_command = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Running cmd (subprocess): mount.quobyte {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] cinder_sys_admin.user          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.auth_section      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.auth_type         = password {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.cafile            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.certfile          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.collect_timing    = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.insecure          = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.keyfile           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.send_service_user_token = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.split_loggers     = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] service_user.timeout           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.auth_section            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.auth_type               = password {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.certfile                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.collect_timing          = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.insecure                = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.keyfile                 = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.region_name             = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.split_loggers           = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] glance.timeout                 = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.backend_availability_zone = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.chap_password = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.chap_username =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.disk_geometry = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_client_cert = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_client_cert_key = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_data_namespace = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.driver_use_ssl = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.enable_unsupported_driver = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.extra_capabilities = {} {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.filter_function = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.goodness_function = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iscsi_target_flags =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iscsi_write_cache = on {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iser_helper   = tgtadm {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iser_ip_address = 192.168.122.230 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iser_port     = 3260 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_host      =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_login     = admin {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_mount_options = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_password  = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_private_key =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_share_path =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.num_shell_tries = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.nvmet_port_id = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_client_cfg = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.quobyte_volume_url = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.replication_device = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.report_discard_supported = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.reserved_percentage = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.scst_target_driver = iscsi {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.scst_target_iqn_name = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.storage_protocol = iSCSI {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_helper = tgtadm {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_ip_address = 192.168.122.230 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_port   = 3260 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_protocol = iscsi {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.trace_flags   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.unique_fqdn_network = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.use_chap_auth = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_backend_name = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_clear  = zero {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_clear_ionice = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_clear_size = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_reports.file_event_handler = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_reports.log_dir           = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.backend_availability_zone = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.backend_host         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.chap_password        = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.chap_username        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.chiscsi_conf         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.disk_geometry        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_client_cert   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_client_cert_key = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_data_namespace = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.driver_use_ssl       = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.extra_capabilities   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.filter_function      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.goodness_function    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iser_helper          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iser_ip_address      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iser_port            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.iser_target_prefix   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_host             = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_login            = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_mount_options    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_password         = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_private_key      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_share_path       = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_ssh_port         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.num_shell_tries      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.nvmet_port_id        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.replication_device   = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.report_discard_supported = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.reserved_percentage  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.scst_target_driver   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.storage_protocol     = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_helper        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_ip_address    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_port          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_prefix        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_protocol      = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.trace_flags          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.use_chap_auth        = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_clear         = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_clear_size    = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] QuobyteHD.volumes_dir          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl      = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_notifications.driver = [] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_notifications.retry = -1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] oslo_messaging_notifications.transport_url = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] key_manager.fixed_key          = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.barbican_api_version  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.barbican_endpoint     = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.barbican_endpoint_type = public {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.barbican_region_name  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.cafile                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.certfile              = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.collect_timing        = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.insecure              = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.keyfile               = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.number_of_retries     = 60 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.retry_delay           = 1 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.send_service_user_token = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.split_loggers         = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.timeout               = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.verify_ssl            = True {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican.verify_ssl_path       = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.auth_section = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.auth_type = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.cafile   = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.certfile = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.collect_timing = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.insecure = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.keyfile  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.split_loggers = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] barbican_service_user.timeout  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.approle_role_id          = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.approle_secret_id        = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.kv_mountpoint            = secret {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.kv_path                  = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.kv_version               = 2 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.namespace                = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.root_token_id            = **** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.ssl_ca_crt_file          = None {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.timeout                  = 60.0 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.use_ssl                  = False {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 08:31:32 devstack cinder-volume[83848]: DEBUG oslo_service.backend._eventlet.service [None req-be44cf25-fdf3-4f3b-a37e-cd2841a7630f None None] ******************************************************************************** {{(pid=83848) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 08:31:33 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.592s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:33 devstack cinder-volume[84102]: INFO cinder.volume.driver [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG cinder.volume.driver [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84102) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_db.sqlalchemy.engines [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84102) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writer thread running {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG cinder.db.sqlalchemy.api [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Building query based on filter {{(pid=84102) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84102) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:33 devstack cinder-volume[84102]: INFO cinder.keymgr.migration [None req-2b734f18-40a8-4865-bbda-62c4909106d4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 08:31:33 devstack sudo[84112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:33 devstack sudo[84112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:34 devstack sudo[84112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.620s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:31:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Driver initialization completed successfully.
Apr 29 08:31:34 devstack cinder-volume[84102]: INFO cinder.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Initiating service 3 cleanup
Apr 29 08:31:34 devstack cinder-volume[84102]: INFO cinder.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Service 3 cleanup completed.
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG cinder.service [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Creating RPC server for service cinder-volume {{(pid=84102) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG cinder.service [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84102) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 08:31:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:31:34 devstack sudo[84115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:31:34 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:31:34 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root
Apr 29 08:31:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.619s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:31:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-29cf59cd-6902-4ce3-bfeb-59bad009722b None None] Driver post RPC initialization completed successfully.
Apr 29 08:31:42 devstack cinder-volume[83848]: DEBUG dbcounter [-] [83848] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:31:44 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=2 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:31:44 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Flow 'volume_create_manager' (8aa967fa-99e5-4f25-abd3-eec47a742142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3742a56f-982a-4c60-941a-764a89cf8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3742a56f-982a-4c60-941a-764a89cf8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1643864064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaa0fb7-a505-4e14-a2a3-5560c1ea4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e371b267cb402f8460e87ec1047206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:06Z,use_quota=True,user_id='e4a072aedef34b6c98fb478a27f8ba72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df74efe1-2464-4728-bf58-4823b0a49890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df74efe1-2464-4728-bf58-4823b0a49890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6534fb7f-0a24-4df4-a423-a0d04e036c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6534fb7f-0a24-4df4-a423-a0d04e036c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaa0fb7-a505-4e14-a2a3-5560c1ea4596', 'volume_name': 'volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b228c92-02ad-479a-a831-397efe7c8857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b228c92-02ad-479a-a831-397efe7c8857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa30639-e269-4ce9-8ac8-69a2a1fab6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:07 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Volume acaa0fb7-a505-4e14-a2a3-5560c1ea4596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596', 'volume_size': 1}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1643864064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaa0fb7-a505-4e14-a2a3-5560c1ea4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e371b267cb402f8460e87ec1047206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:06Z,use_quota=True,user_id='e4a072aedef34b6c98fb478a27f8ba72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Creating volume acaa0fb7-a505-4e14-a2a3-5560c1ea4596 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:07 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:33:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:07 devstack sudo[84815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 1073741824
Apr 29 08:33:07 devstack sudo[84815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:10 devstack sudo[84815]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 1073741824" returned: 0 in 3.056s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:10 devstack sudo[85213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596
Apr 29 08:33:10 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:12 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" returned: 0 in 1.872s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] <== create_volume: return (5115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.122s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa30639-e269-4ce9-8ac8-69a2a1fab6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcdac92-4c0f-4675-af4c-8be3bf4ff3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Volume volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 (acaa0fb7-a505-4e14-a2a3-5560c1ea4596): created successfully
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcdac92-4c0f-4675-af4c-8be3bf4ff3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Flow 'volume_create_manager' (8aa967fa-99e5-4f25-abd3-eec47a742142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:12 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ad3838d6-c57a-4f3b-bd08-7c6d026cccef tempest-VolumesAdminNegativeTest-1361115599 None] Created volume successfully.
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Acquiring lock "cinder-acaa0fb7-a505-4e14-a2a3-5560c1ea4596-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "cinder-acaa0fb7-a505-4e14-a2a3-5560c1ea4596-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Acquiring lock "cinder-quobyte-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "cinder-quobyte-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" acquired by "delete_volume" :: waited 0.062s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:14 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9u37xpnz/privsep.sock']
Apr 29 08:33:14 devstack sudo[85247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9u37xpnz/privsep.sock
Apr 29 08:33:14 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Flow 'volume_create_manager' (80c711a9-6d52-45ed-9173-c6c92464a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81458f4-e6c5-483a-8da6-d300efaca83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81458f4-e6c5-483a-8da6-d300efaca83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1234892706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2b1d75-5ae7-4d67-b9bb-a53e156c028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0301fe9a249ea81199f7d9c22a339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:14Z,use_quota=True,user_id='368572e57a8b4d428ab62e3f4ea53bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbd0120-106e-4ea8-9b73-5f2d0d285a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbd0120-106e-4ea8-9b73-5f2d0d285a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb062e-9d4c-4d53-b72f-ced8ad8b5301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cb062e-9d4c-4d53-b72f-ced8ad8b5301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2b1d75-5ae7-4d67-b9bb-a53e156c028b', 'volume_name': 'volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d559a627-a3c9-4450-99e2-97e5208f0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d559a627-a3c9-4450-99e2-97e5208f0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf25a7-363f-4754-b0e9-e0b08fb42812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Volume 9b2b1d75-5ae7-4d67-b9bb-a53e156c028b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b', 'volume_size': 1}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1234892706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2b1d75-5ae7-4d67-b9bb-a53e156c028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71b0301fe9a249ea81199f7d9c22a339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:14Z,use_quota=True,user_id='368572e57a8b4d428ab62e3f4ea53bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Creating volume 9b2b1d75-5ae7-4d67-b9bb-a53e156c028b {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:15 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:33:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:15 devstack sudo[85265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b 1073741824
Apr 29 08:33:15 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:17 devstack sudo[85274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:33:17 devstack sudo[85274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:17 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b 1073741824" returned: 0 in 2.572s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:18 devstack sudo[85279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b
Apr 29 08:33:18 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:18 devstack sudo[85274]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 2.045s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:18 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:19 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" returned: 0 in 1.622s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] <== create_volume: return (4430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.444s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7bf25a7-363f-4754-b0e9-e0b08fb42812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274ca345-16bc-4dde-8251-b55e78f17341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:19 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Volume volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b (9b2b1d75-5ae7-4d67-b9bb-a53e156c028b): created successfully
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274ca345-16bc-4dde-8251-b55e78f17341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Flow 'volume_create_manager' (80c711a9-6d52-45ed-9173-c6c92464a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-42855699-64fc-4f5f-9c2d-6506a9e61b59 tempest-ServerRescueNegativeTestJSON-405532107 None] Created volume successfully.
Apr 29 08:33:20 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:20 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Spawned new privsep daemon via rootwrap
Apr 29 08:33:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Accepted privsep connection to /tmp/tmp9u37xpnz/privsep.sock {{(pid=84102) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Apr 29 08:33:20 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 29 08:33:20 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 29 08:33:20 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 29 08:33:20 devstack cinder-volume[84102]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85283
Apr 29 08:33:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43a7e0-f735-44ae-9f17-c962df01dd07]: (2,) {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292b461-a678-4fb4-8802-2e74e0b9562c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:20 devstack sudo[85286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596
Apr 29 08:33:20 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:22 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" returned: 0 in 1.938s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:22 devstack sudo[85292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596
Apr 29 08:33:22 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:24 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" returned: 0 in 1.908s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "cinder-quobyte-acaa0fb7-a505-4e14-a2a3-5560c1ea4596" released by "delete_volume" :: held 9.665s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:24 devstack cinder-volume[84102]: WARNING cinder.quota [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:24 devstack cinder-volume[84102]: WARNING cinder.quota [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Created reservations ['c8e66e6b-d387-4783-966e-cb99f6e1f854', '67add9ec-80a2-4fc7-a884-558a1d236503', 'e7c926c6-6bb5-42ad-ade5-fd7d27c52a30', '7e363d2d-719e-4cfe-a53a-f40c904410d5'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:24 devstack sudo[85354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:33:24 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:25 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.113s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:25 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:25 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Deleted volume successfully.
Apr 29 08:33:25 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7515f832-a1f8-4078-9bb3-63017b7cbd37 tempest-VolumesAdminNegativeTest-1361115599 None] Lock "cinder-acaa0fb7-a505-4e14-a2a3-5560c1ea4596-delete_volume" released by "delete_volume" :: held 11.574s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Flow 'volume_create_manager' (f66076d6-05ce-459b-a84b-ff1e0a734d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4339dc-5dad-4a07-9c78-8e7dd7b1369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4339dc-5dad-4a07-9c78-8e7dd7b1369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-433927276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411fc755-bf42-4f4b-9257-2ec777f6f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f120a3636604ead93103560bc529ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:33Z,use_quota=True,user_id='fa2a61a4434148298384b19cffc2eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f609971-6e59-4137-81de-197c90ffbf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f609971-6e59-4137-81de-197c90ffbf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0aafb4-54b2-4674-b706-0d6b14287e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0aafb4-54b2-4674-b706-0d6b14287e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411fc755-bf42-4f4b-9257-2ec777f6f28f', 'volume_name': 'volume-411fc755-bf42-4f4b-9257-2ec777f6f28f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36fc91e-fea9-467c-998c-ac281a7dcc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36fc91e-fea9-467c-998c-ac281a7dcc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767f0bd1-263e-4574-86e3-febdf0f40139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:32 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Volume 411fc755-bf42-4f4b-9257-2ec777f6f28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411fc755-bf42-4f4b-9257-2ec777f6f28f', 'volume_size': 1}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-433927276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411fc755-bf42-4f4b-9257-2ec777f6f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f120a3636604ead93103560bc529ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:33Z,use_quota=True,user_id='fa2a61a4434148298384b19cffc2eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Creating volume 411fc755-bf42-4f4b-9257-2ec777f6f28f {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:32 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:33:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:32 devstack sudo[85525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f 1073741824
Apr 29 08:33:32 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:34 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f 1073741824" returned: 0 in 1.344s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:34 devstack sudo[85534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f
Apr 29 08:33:34 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:35 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f" returned: 0 in 1.498s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.932s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767f0bd1-263e-4574-86e3-febdf0f40139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411fc755-bf42-4f4b-9257-2ec777f6f28f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb6c6d-e769-4ff2-a11b-3f4142923217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:35 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Volume volume-411fc755-bf42-4f4b-9257-2ec777f6f28f (411fc755-bf42-4f4b-9257-2ec777f6f28f): created successfully
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb6c6d-e769-4ff2-a11b-3f4142923217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Flow 'volume_create_manager' (f66076d6-05ce-459b-a84b-ff1e0a734d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fcea0dbf-e10b-447a-9187-8bff72159805 tempest-ServersNegativeTestJSON-1604792466 None] Created volume successfully.
Apr 29 08:33:40 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:33:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Flow 'volume_create_manager' (a62ae638-087c-4ab7-92ab-800d23a51ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1417d91-68e8-4ef8-b53b-d06a43cee12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1417d91-68e8-4ef8-b53b-d06a43cee12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795572830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d283e16-bf1c-452a-9bae-a664b16e2af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f120a3636604ead93103560bc529ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:41Z,use_quota=True,user_id='fa2a61a4434148298384b19cffc2eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad66d4e-8f94-4fca-8dea-c213f7741ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad66d4e-8f94-4fca-8dea-c213f7741ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ca45c-9d15-4d85-ab05-88ebc8d7970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ca45c-9d15-4d85-ab05-88ebc8d7970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d283e16-bf1c-452a-9bae-a664b16e2af4', 'volume_name': 'volume-7d283e16-bf1c-452a-9bae-a664b16e2af4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32110b39-966a-492a-b89c-a2db0677bebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32110b39-966a-492a-b89c-a2db0677bebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7524b46-18dc-4468-b206-8cb7fc822116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:41 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Volume 7d283e16-bf1c-452a-9bae-a664b16e2af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d283e16-bf1c-452a-9bae-a664b16e2af4', 'volume_size': 1}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1795572830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d283e16-bf1c-452a-9bae-a664b16e2af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f120a3636604ead93103560bc529ca6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:33:41Z,use_quota=True,user_id='fa2a61a4434148298384b19cffc2eedf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Creating volume 7d283e16-bf1c-452a-9bae-a664b16e2af4 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:33:41 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:33:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:41 devstack sudo[85579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 1073741824
Apr 29 08:33:41 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:42 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 1073741824" returned: 0 in 1.290s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:42 devstack sudo[85620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4
Apr 29 08:33:42 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:43 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4" returned: 0 in 0.868s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] <== create_volume: return (2216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7524b46-18dc-4468-b206-8cb7fc822116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d283e16-bf1c-452a-9bae-a664b16e2af4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8f9125-4c6b-4344-8abf-aea7bb88b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:33:43 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Volume volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 (7d283e16-bf1c-452a-9bae-a664b16e2af4): created successfully
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8f9125-4c6b-4344-8abf-aea7bb88b971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:33:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Flow 'volume_create_manager' (a62ae638-087c-4ab7-92ab-800d23a51ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:33:43 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d14b6ee3-1f15-4c94-83e7-ec9c807a4113 tempest-ServersNegativeTestJSON-1604792466 None] Created volume successfully.
Apr 29 08:33:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "cinder-7d283e16-bf1c-452a-9bae-a664b16e2af4-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-7d283e16-bf1c-452a-9bae-a664b16e2af4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "cinder-quobyte-7d283e16-bf1c-452a-9bae-a664b16e2af4" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-quobyte-7d283e16-bf1c-452a-9bae-a664b16e2af4" acquired by "delete_volume" :: waited 0.041s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:45 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5255b84c-11d0-43c8-a7ac-b6caef04e839]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:45 devstack sudo[85661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4
Apr 29 08:33:45 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:46 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4" returned: 0 in 1.183s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:46 devstack sudo[85667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4
Apr 29 08:33:46 devstack sudo[85667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:47 devstack sudo[85667]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7d283e16-bf1c-452a-9bae-a664b16e2af4" returned: 0 in 1.061s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-quobyte-7d283e16-bf1c-452a-9bae-a664b16e2af4" released by "delete_volume" :: held 2.356s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Created reservations ['eea229a6-8474-4bed-9364-57fc37abbc28', '6cc10e43-a57a-42c7-9b8d-ba9b57426b03', 'e280793f-a742-4bc6-9315-bf74cc8ff91d', 'c18de6ca-0baf-4c39-86c0-bd50e29d6e8b'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:47 devstack sudo[85689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:33:47 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "cinder-411fc755-bf42-4f4b-9257-2ec777f6f28f-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-411fc755-bf42-4f4b-9257-2ec777f6f28f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "cinder-quobyte-411fc755-bf42-4f4b-9257-2ec777f6f28f" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-quobyte-411fc755-bf42-4f4b-9257-2ec777f6f28f" acquired by "delete_volume" :: waited 0.036s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Acquiring lock "cinder-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac8b5d-1ecc-439a-ba8b-370c1be158e1]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "cinder-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:48 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.101s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Deleted volume successfully.
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Acquiring lock "cinder-quobyte-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37677b32-f9d7-4022-b070-080938629f68 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-7d283e16-bf1c-452a-9bae-a664b16e2af4-delete_volume" released by "delete_volume" :: held 3.909s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "cinder-quobyte-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd4b77-2c92-4103-8c23-fadb8090976d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:33:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:48 devstack sudo[85694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f
Apr 29 08:33:48 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:49 devstack sudo[85695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b
Apr 29 08:33:49 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:50 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f" returned: 0 in 1.428s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:50 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" returned: 0 in 1.338s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:50 devstack sudo[85740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f
Apr 29 08:33:50 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:50 devstack sudo[85741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b
Apr 29 08:33:50 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:51 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" returned: 0 in 0.940s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "cinder-quobyte-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b" released by "delete_volume" :: held 2.338s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:51 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-411fc755-bf42-4f4b-9257-2ec777f6f28f" returned: 0 in 1.064s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-quobyte-411fc755-bf42-4f4b-9257-2ec777f6f28f" released by "delete_volume" :: held 2.571s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Created reservations ['f9881145-a48f-4306-a007-3e245af41954', '19b7a2fc-79ff-4f9a-991c-138dd5a42b59', 'a747a3a7-cbee-491d-8c72-7629dafcba7e', '73057c19-ee43-41dd-b9d3-2fc4cc59e5b0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Created reservations ['e33be3e5-9349-4186-960c-52bbf94234b6', '7c4774c3-27ea-490b-a400-7d646530a4f6', '1901b4ef-9113-4991-ab52-5e3d23ca592b', '54cc50c9-4f1d-43ee-a918-143b6f831ed8'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:51 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:33:51 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:33:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:33:51 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:33:51 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:33:52 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.031s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Deleted volume successfully.
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-da7aad3c-2b06-4bc0-958d-31c421cc5ae4 tempest-ServerRescueNegativeTestJSON-405532107 None] Lock "cinder-9b2b1d75-5ae7-4d67-b9bb-a53e156c028b-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:33:52 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.197s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:33:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Deleted volume successfully.
Apr 29 08:33:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bef8ed92-feb7-4163-bb06-c1e85d9235e6 tempest-ServersNegativeTestJSON-1604792466 None] Lock "cinder-411fc755-bf42-4f4b-9257-2ec777f6f28f-delete_volume" released by "delete_volume" :: held 4.226s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:02 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=22,cinder:UPDATE=44,cinder:DELETE=3,cinder:INSERT=10 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:34:02 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=45,cinder:SELECT=35,cinder:INSERT=10,cinder:DELETE=5 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Flow 'volume_create_manager' (ad088878-7f95-49de-918f-23aa5fdd9d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d3fe42-4a69-45df-83b5-d852a0d74313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d3fe42-4a69-45df-83b5-d852a0d74313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-745440014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373cd142e11144168205ca1539cd5ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:13Z,use_quota=True,user_id='5949b8980dfe4b639e0d100575962ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1405cb4a-4ead-407f-9b1e-3b15f19efd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1405cb4a-4ead-407f-9b1e-3b15f19efd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317b4184-2458-4445-8846-a951c3b652cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317b4184-2458-4445-8846-a951c3b652cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21', 'volume_name': 'volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723e39ed-bbbc-4d37-99f8-50c89e1e584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723e39ed-bbbc-4d37-99f8-50c89e1e584f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91339736-13d5-4ab7-9855-d1fd23490df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Volume ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21', 'volume_size': 1}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-745440014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373cd142e11144168205ca1539cd5ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:13Z,use_quota=True,user_id='5949b8980dfe4b639e0d100575962ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Creating volume ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:13 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:13 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 1073741824
Apr 29 08:34:13 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:14 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 1073741824" returned: 0 in 0.935s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:14 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21
Apr 29 08:34:14 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:15 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" returned: 0 in 0.639s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91339736-13d5-4ab7-9855-d1fd23490df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d3b5be-0d80-47e0-80e8-73e3516fbdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Volume volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 (ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21): created successfully
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d3b5be-0d80-47e0-80e8-73e3516fbdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Flow 'volume_create_manager' (ad088878-7f95-49de-918f-23aa5fdd9d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-d7a8f5bd-896e-43e7-b149-3983fafa9817 req-fe3f9629-04dd-4232-971f-3d1cf0a1469b tempest-VolumesSnapshotsTestJSON-87557077 None] Created volume successfully.
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:16 devstack sudo[86031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:34:16 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:17 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.631s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Creating offline snapshot 63d622b5-f504-4be9-ae2f-89985de800ca of volume ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:34:21 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c03e9-4feb-4069-9d65-f8ce5a465bc6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:21 devstack sudo[86037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21
Apr 29 08:34:21 devstack sudo[86037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:22 devstack sudo[86037]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" returned: 0 in 1.390s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:22 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca 1G
Apr 29 08:34:22 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:23 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca 1G" returned: 0 in 1.039s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:23 devstack sudo[86051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca
Apr 29 08:34:23 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:24 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca" returned: 0 in 0.809s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:24 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca is being set with open permissions: ugo+rw
Apr 29 08:34:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:24 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca
Apr 29 08:34:24 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:25 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca" returned: 0 in 0.606s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:25 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info
Apr 29 08:34:25 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:25 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info" returned: 0 in 0.692s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:25 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info is being set with open permissions: ugo+rw
Apr 29 08:34:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:25 devstack sudo[86067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info
Apr 29 08:34:25 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e65ec405-a932-4697-8cce-ea80916c5401 tempest-BackendsCapabilitiesAdminTestsJSON-1997408275 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84102) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 08:34:26 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.info" returned: 0 in 0.670s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.376s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:26 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-c81d390f-8d28-4f51-bbba-1c276d365384 req-4d7febaa-1610-4951-b237-eed279d8e3f3 tempest-VolumesSnapshotsTestJSON-87557077 None] Create snapshot completed successfully
Apr 29 08:34:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c2157cac-2372-4f7f-9cbb-be4a23823a02 tempest-BackendsCapabilitiesAdminTestsJSON-1997408275 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6515808105469, 'free_capacity_gb': 1775.6515808105469, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84102) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "cinder-63d622b5-f504-4be9-ae2f-89985de800ca-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-63d622b5-f504-4be9-ae2f-89985de800ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "cinder-quobyte-63d622b5-f504-4be9-ae2f-89985de800ca" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-63d622b5-f504-4be9-ae2f-89985de800ca" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Deleting offline snapshot 63d622b5-f504-4be9-ae2f-89985de800ca of volume ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] snapshot_file for this snap is: volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[497913b7-a3ed-4aef-8d5b-a1b01a166332]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:27 devstack sudo[86070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca
Apr 29 08:34:27 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:28 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca" returned: 0 in 1.086s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dfe829-5a60-4144-99a5-521a66d633e3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Flow 'volume_create_manager' (f3cf4fe4-e284-4b1f-a39f-c0886b5832c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0fab40-560d-444a-ad1e-8803d3403f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f0fab40-560d-444a-ad1e-8803d3403f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:28Z,deleted=False,deleted_at=None,display_description='',display_name='30c9f131-fb9a-435a-9776-c4354e09ab15-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f501056b-cb20-412d-95df-9faa3745d687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd493ed0091f45c9b46e78f933e2b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:29Z,use_quota=True,user_id='6bd2e1809aee460d8e9ab9486db239e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411990f2-ed82-4d9c-a912-356d3063c583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411990f2-ed82-4d9c-a912-356d3063c583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1843a5a4-f825-4b6d-95d1-244ba072ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1843a5a4-f825-4b6d-95d1-244ba072ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f501056b-cb20-412d-95df-9faa3745d687', 'volume_name': 'volume-f501056b-cb20-412d-95df-9faa3745d687', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2572a533-55c6-4f58-a0a2-34ff1ca9f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2572a533-55c6-4f58-a0a2-34ff1ca9f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117b68aa-9ccd-4be7-820c-8dec006d0c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume f501056b-cb20-412d-95df-9faa3745d687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f501056b-cb20-412d-95df-9faa3745d687', 'volume_size': 1}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:28Z,deleted=False,deleted_at=None,display_description='',display_name='30c9f131-fb9a-435a-9776-c4354e09ab15-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f501056b-cb20-412d-95df-9faa3745d687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd493ed0091f45c9b46e78f933e2b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:29Z,use_quota=True,user_id='6bd2e1809aee460d8e9ab9486db239e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Creating volume f501056b-cb20-412d-95df-9faa3745d687 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:29 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:29 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21
Apr 29 08:34:29 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:29 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 1073741824
Apr 29 08:34:29 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:30 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" returned: 0 in 1.156s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:30 devstack sudo[86089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca
Apr 29 08:34:30 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:30 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 1073741824" returned: 0 in 1.176s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:30 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687
Apr 29 08:34:30 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:31 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687" returned: 0 in 0.932s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (117b68aa-9ccd-4be7-820c-8dec006d0c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f501056b-cb20-412d-95df-9faa3745d687', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3061e954-e421-4433-b122-c3c5a7292842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:31 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume volume-f501056b-cb20-412d-95df-9faa3745d687 (f501056b-cb20-412d-95df-9faa3745d687): created successfully
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3061e954-e421-4433-b122-c3c5a7292842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Flow 'volume_create_manager' (f3cf4fe4-e284-4b1f-a39f-c0886b5832c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-b6b22342-d5e2-4bd1-b218-1a42c427fc98 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Created volume successfully.
Apr 29 08:34:31 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca" returned: 0 in 1.322s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:31 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca
Apr 29 08:34:31 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:32 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21.63d622b5-f504-4be9-ae2f-89985de800ca" returned: 0 in 0.755s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-63d622b5-f504-4be9-ae2f-89985de800ca" released by "_delete_snapshot" :: held 4.557s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" released by "delete_snapshot" :: held 4.600s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:32 devstack cinder-volume[84102]: WARNING cinder.quota [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:34:32 devstack cinder-volume[84102]: DEBUG cinder.quota [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Created reservations ['fc608892-b883-46bc-915f-d163cfb0cd29', '04d20ab1-d480-4462-857f-4af7db98ba46', 'e745261b-c784-445a-9f3a-3af31563c19a', '5b43a819-cd30-4112-b4d4-5d05d852ba06'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Delete snapshot completed successfully.
Apr 29 08:34:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-45c51c95-6abb-41a3-a287-9046c179e7d9 req-443adc5e-b383-4107-9183-5b8f5763e5ae tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-63d622b5-f504-4be9-ae2f-89985de800ca-delete_snapshot" released by "delete_snapshot" :: held 4.852s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "cinder-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5c6e9-d792-4b55-8281-e8fee0b148ae]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:33 devstack sudo[86121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21
Apr 29 08:34:33 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:34 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" returned: 0 in 0.990s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:34 devstack sudo[86137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21
Apr 29 08:34:34 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:34 devstack cinder-volume[84102]: WARNING py.warnings [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 29 08:34:34 devstack cinder-volume[84102]:   .first()
Apr 29 08:34:34 devstack cinder-volume[84102]: 
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bcbe53-f3d2-47af-a9cf-34e74485c1dc]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:34 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687
Apr 29 08:34:34 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ee0e296a-727a-4e05-aca0-0f88a3bce4cd tempest-GroupsTest-322582594 None] Group tempest-Group1-2027096513: creating
Apr 29 08:34:35 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" returned: 0 in 0.790s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ee0e296a-727a-4e05-aca0-0f88a3bce4cd tempest-GroupsTest-322582594 None] Group tempest-Group1-2027096513: created successfully
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-quobyte-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21" released by "delete_volume" :: held 1.888s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ee0e296a-727a-4e05-aca0-0f88a3bce4cd tempest-GroupsTest-322582594 None] Create group completed successfully.
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG cinder.quota [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Created reservations ['3dfb4238-4d83-494f-894c-2985a3f04bb2', '2f584c4a-090e-4796-b1ab-0961caf7a973', 'ec25f474-c8f7-4b85-8c10-e72994377a83', 'e879f868-22e7-4bb1-b75f-f5117c5931ef'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:35 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687" returned: 0 in 0.853s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:35 devstack sudo[86145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:34:35 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336', 'name': 'volume-f501056b-cb20-412d-95df-9faa3745d687', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f25012a-ae34-41a8-bc73-06217fe06de0', 'enforce_multipath': True} {{(pid=84102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:34:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-7d724c62-23f8-46e7-a0bc-cde16ba55e15 req-64ebb22a-096a-4e4f-87c5-5bbed5abbc0b tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] attachment_update completed successfully.
Apr 29 08:34:36 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.661s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:36 devstack cinder-volume[84102]: DEBUG cinder.manager [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Deleted volume successfully.
Apr 29 08:34:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-32d06369-0639-4bf4-97e2-d47e07006995 req-f0a44553-8dd6-4350-81b1-66b088238478 tempest-VolumesSnapshotsTestJSON-87557077 None] Lock "cinder-ce4c5a54-f45d-4fcf-b3a1-b4e0832d2d21-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-25f9c44e-6aca-4ce7-bf91-cb68d557c5bd tempest-GroupsTest-322582594 None] Group tempest-Group2-1446987349: creating
Apr 29 08:34:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-25f9c44e-6aca-4ce7-bf91-cb68d557c5bd tempest-GroupsTest-322582594 None] Group tempest-Group2-1446987349: created successfully
Apr 29 08:34:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-25f9c44e-6aca-4ce7-bf91-cb68d557c5bd tempest-GroupsTest-322582594 None] Create group completed successfully.
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (dc3ef46c-b537-448e-b4d8-1a3ea30137d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480e845-aeda-464c-bf9e-64e9f975e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1480e845-aeda-464c-bf9e-64e9f975e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1446152650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=88e77e9f-0ce1-49f0-9ee1-0fb4917bf074,host='devstack@QuobyteHD#QuobyteHD',id=4955df34-a705-47ec-a948-c67ba5060167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:38Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3be172c1-fc28-444b-8ee9-c3a953465993),volume_type_id=3be172c1-fc28-444b-8ee9-c3a953465993)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5883bd-bdd5-4480-8b96-88c3ac275ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5883bd-bdd5-4480-8b96-88c3ac275ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ab4378-9ec2-44b7-b12e-6eb0f199582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ab4378-9ec2-44b7-b12e-6eb0f199582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4955df34-a705-47ec-a948-c67ba5060167', 'volume_name': 'volume-4955df34-a705-47ec-a948-c67ba5060167', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7b13c-3aef-4932-9170-735e83ca8922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd7b13c-3aef-4932-9170-735e83ca8922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b61ebc-efc5-4dc9-8701-cb10372c3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:38 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Volume 4955df34-a705-47ec-a948-c67ba5060167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4955df34-a705-47ec-a948-c67ba5060167', 'volume_size': 1}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=88e77e9f-0ce1-49f0-9ee1-0fb4917bf074,created_at=2026-04-29T06:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1446152650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=88e77e9f-0ce1-49f0-9ee1-0fb4917bf074,host='devstack@QuobyteHD#QuobyteHD',id=4955df34-a705-47ec-a948-c67ba5060167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:38Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3be172c1-fc28-444b-8ee9-c3a953465993),volume_type_id=3be172c1-fc28-444b-8ee9-c3a953465993)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Creating volume 4955df34-a705-47ec-a948-c67ba5060167 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:38 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:38 devstack sudo[86217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 1073741824
Apr 29 08:34:38 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:39 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 1073741824" returned: 0 in 1.631s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:39 devstack sudo[86291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167
Apr 29 08:34:39 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:40 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167" returned: 0 in 0.719s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.451s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2b61ebc-efc5-4dc9-8701-cb10372c3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4955df34-a705-47ec-a948-c67ba5060167', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519d9b45-88cf-407f-8f2d-1ffabeaaf9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Volume volume-4955df34-a705-47ec-a948-c67ba5060167 (4955df34-a705-47ec-a948-c67ba5060167): created successfully
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519d9b45-88cf-407f-8f2d-1ffabeaaf9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (dc3ef46c-b537-448e-b4d8-1a3ea30137d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-238a2b16-ff5f-454e-b509-365f7c83046c tempest-GroupsTest-322582594 None] Created volume successfully.
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Flow 'volume_create_manager' (1d8ec37d-837e-4008-95aa-69d7d20e0ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8fc071-3cf1-4cd8-ae06-3792acf4f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8fc071-3cf1-4cd8-ae06-3792acf4f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-753738257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93a7430-05dc-404c-a638-0c8af5542a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e7a7529eaa4bd58b09993a29bb69b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:44Z,use_quota=True,user_id='852aa0e50bbf4a0c8efe7655abc50869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a456d-b16d-4910-b69d-e23487beab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a456d-b16d-4910-b69d-e23487beab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0feb2b0-2625-4047-b0cf-deda4fb12cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0feb2b0-2625-4047-b0cf-deda4fb12cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93a7430-05dc-404c-a638-0c8af5542a28', 'volume_name': 'volume-f93a7430-05dc-404c-a638-0c8af5542a28', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64a2a79-472d-411e-9f46-4733543b96ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64a2a79-472d-411e-9f46-4733543b96ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13b4bfb-99b5-4c64-a079-a0f31f83c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:43 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Volume f93a7430-05dc-404c-a638-0c8af5542a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93a7430-05dc-404c-a638-0c8af5542a28', 'volume_size': 1}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-753738257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93a7430-05dc-404c-a638-0c8af5542a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e7a7529eaa4bd58b09993a29bb69b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:44Z,use_quota=True,user_id='852aa0e50bbf4a0c8efe7655abc50869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Creating volume f93a7430-05dc-404c-a638-0c8af5542a28 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:43 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Acquiring lock "cinder-quobyte-4955df34-a705-47ec-a948-c67ba5060167" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:34:44 devstack sudo[86649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 1073741824
Apr 29 08:34:44 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-4955df34-a705-47ec-a948-c67ba5060167" acquired by "delete_volume" :: waited 0.063s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:34:44 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[63771a46-015a-4d12-91fc-24cf5621227d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:44 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167
Apr 29 08:34:44 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:45 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167" returned: 0 in 1.469s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:45 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 1073741824" returned: 0 in 1.700s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:45 devstack sudo[86669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167
Apr 29 08:34:45 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:45 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28
Apr 29 08:34:45 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:46 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4955df34-a705-47ec-a948-c67ba5060167" returned: 0 in 0.993s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-4955df34-a705-47ec-a948-c67ba5060167" released by "delete_volume" :: held 2.572s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:34:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Created reservations ['b07a579d-5750-4c48-a846-e3c1609492af'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:46 devstack cinder-volume[84102]: WARNING cinder.quota [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2109250202 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2109250202, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:34:46 devstack cinder-volume[84102]: WARNING cinder.quota [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2109250202 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2109250202, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:34:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Created reservations ['5ced6279-dd53-42a8-8cf3-4a6ae875ca81', 'eb338aa5-92e3-4b6b-8bc5-a32a4ac806f5', '15d2b68c-cbde-4186-b8c1-04af6e274be2', '93431dbf-b906-4f99-b416-95e8903ee656'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:47 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28" returned: 0 in 1.380s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] <== create_volume: return (3158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.165s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13b4bfb-99b5-4c64-a079-a0f31f83c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93a7430-05dc-404c-a638-0c8af5542a28', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd8801-bd3e-4aec-b5ca-0aea5da176a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:47 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Volume volume-f93a7430-05dc-404c-a638-0c8af5542a28 (f93a7430-05dc-404c-a638-0c8af5542a28): created successfully
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cd8801-bd3e-4aec-b5ca-0aea5da176a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Flow 'volume_create_manager' (1d8ec37d-837e-4008-95aa-69d7d20e0ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5034615f-3de1-4297-90da-cd8049f890db tempest-DeleteServersTestJSON-773612904 None] Created volume successfully.
Apr 29 08:34:47 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:34:47 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Created reservations ['b0e24638-d4f8-4f17-98fe-7d7f803990b1'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:47 devstack sudo[86678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:34:47 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-913c96d7-6303-4327-a93f-c2a2a8b5d1ab tempest-GroupSnapshotsV319Test-725772124 None] Group tempest-GroupSnapshotsV319Test-Group-1440168712: creating
Apr 29 08:34:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-913c96d7-6303-4327-a93f-c2a2a8b5d1ab tempest-GroupSnapshotsV319Test-725772124 None] Group tempest-GroupSnapshotsV319Test-Group-1440168712: created successfully
Apr 29 08:34:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-913c96d7-6303-4327-a93f-c2a2a8b5d1ab tempest-GroupSnapshotsV319Test-725772124 None] Create group completed successfully.
Apr 29 08:34:48 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.187s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6b686d28-e1ee-47cb-b621-53090ab480fc tempest-GroupsTest-322582594 None] Delete group completed successfully.
Apr 29 08:34:48 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.952s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:34:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-011a46d5-ac7c-4b2e-a301-274f2a53f773 tempest-GroupsTest-322582594 None] Delete group completed successfully.
Apr 29 08:34:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5de4b8e4-8a3f-4a23-8140-ca22cb089321 tempest-GroupsTest-322582594 None] Group tempest-GroupsTest-Group-390801605: creating
Apr 29 08:34:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5de4b8e4-8a3f-4a23-8140-ca22cb089321 tempest-GroupsTest-322582594 None] Group tempest-GroupsTest-Group-390801605: created successfully
Apr 29 08:34:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5de4b8e4-8a3f-4a23-8140-ca22cb089321 tempest-GroupsTest-322582594 None] Create group completed successfully.
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Flow 'volume_create_manager' (98165cc2-8d38-4e8a-80cc-fe90685ccfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756bd4f6-95c2-4625-abdf-526574b4ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756bd4f6-95c2-4625-abdf-526574b4ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-62750134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f8f8fe9-6cf2-471b-811d-2b1c2ae7fa0a,host='devstack@QuobyteHD#QuobyteHD',id=d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e655bfb3542d59759669960f11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:50Z,use_quota=True,user_id='442560961df641c5bb8ac79710288d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00c73955-c52a-4902-a125-e57fab5cb9c3),volume_type_id=00c73955-c52a-4902-a125-e57fab5cb9c3)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb42249-affc-4747-aa37-c94af1594b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb42249-affc-4747-aa37-c94af1594b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941f4387-f32e-4d63-8233-a3b9e8272fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941f4387-f32e-4d63-8233-a3b9e8272fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd213c5e4-8d04-48cc-ab8e-e2c80f7c6e73', 'volume_name': 'volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfd4bd1-20a4-41da-8182-0dcb350e151d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfd4bd1-20a4-41da-8182-0dcb350e151d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c54940-ef24-4012-bebb-6f7771ef66e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Volume d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73', 'volume_size': 1}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2f8f8fe9-6cf2-471b-811d-2b1c2ae7fa0a,created_at=2026-04-29T06:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-62750134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2f8f8fe9-6cf2-471b-811d-2b1c2ae7fa0a,host='devstack@QuobyteHD#QuobyteHD',id=d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678e655bfb3542d59759669960f11d3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:50Z,use_quota=True,user_id='442560961df641c5bb8ac79710288d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00c73955-c52a-4902-a125-e57fab5cb9c3),volume_type_id=00c73955-c52a-4902-a125-e57fab5cb9c3)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Creating volume d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:49 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:50 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 1073741824
Apr 29 08:34:50 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:50 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (41493ae0-cb8d-4483-9dbb-7553fba2219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9716b7-aeb9-4815-ae0b-c386180c8a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9716b7-aeb9-4815-ae0b-c386180c8a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307539564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0eeae059-94ae-421b-949f-b2f367878427,host='devstack@QuobyteHD#QuobyteHD',id=8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:51Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dd2620-7336-4044-9451-ed3a8ee366c2),volume_type_id=26dd2620-7336-4044-9451-ed3a8ee366c2)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252dc102-1c8e-448f-8217-b17541cd7821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252dc102-1c8e-448f-8217-b17541cd7821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6eb795-a6ab-4090-99b6-c6af50fcd313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:51 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6eb795-a6ab-4090-99b6-c6af50fcd313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf', 'volume_name': 'volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6dd978-1a89-40c5-be94-9e262b2ff90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6dd978-1a89-40c5-be94-9e262b2ff90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007a25f-452a-4764-b3f6-5091b37e5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:51 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Volume 8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf', 'volume_size': 1}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 1073741824" returned: 0 in 1.209s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:51 devstack sudo[86726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73
Apr 29 08:34:51 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:52 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" returned: 0 in 1.154s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.202s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0eeae059-94ae-421b-949f-b2f367878427,created_at=2026-04-29T06:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307539564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0eeae059-94ae-421b-949f-b2f367878427,host='devstack@QuobyteHD#QuobyteHD',id=8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:51Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dd2620-7336-4044-9451-ed3a8ee366c2),volume_type_id=26dd2620-7336-4044-9451-ed3a8ee366c2)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Creating volume 8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:34:52 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:52 devstack sudo[86771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf 1073741824
Apr 29 08:34:52 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c54940-ef24-4012-bebb-6f7771ef66e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9f9dbe-beaf-42cd-a782-fb3a1f62726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:52 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Volume volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 (d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73): created successfully
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9f9dbe-beaf-42cd-a782-fb3a1f62726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Flow 'volume_create_manager' (98165cc2-8d38-4e8a-80cc-fe90685ccfa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fc8fd95b-b44e-40ca-8c13-ca44f411d574 tempest-GroupSnapshotsV319Test-725772124 None] Created volume successfully.
Apr 29 08:34:53 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf 1073741824" returned: 0 in 0.985s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:56 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf
Apr 29 08:34:56 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] GroupSnapshot dae2495e-4e5c-492d-9823-145084eea0e0: creating.
Apr 29 08:34:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Group snapshot dae2495e-4e5c-492d-9823-145084eea0e0: creating. {{(pid=84102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:34:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:57 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" returned: 0 in 0.840s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] <== create_volume: return (5017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.019s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.082s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c3112-ebe3-4e61-a308-3b8628d244d8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a007a25f-452a-4764-b3f6-5091b37e5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec310c-92a2-4080-8aba-6eac6e783bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Volume volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf (8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf): created successfully
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec310c-92a2-4080-8aba-6eac6e783bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (41493ae0-cb8d-4483-9dbb-7553fba2219f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:57 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c5aa1f47-9ae3-46f1-809e-ebd6c1135c68 tempest-GroupsTest-322582594 None] Created volume successfully.
Apr 29 08:34:57 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28
Apr 29 08:34:57 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:58 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28" returned: 0 in 0.700s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.730s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.222s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Creating offline snapshot 5e91638f-831f-4e9f-9eb4-ebb3eec6d769 of volume d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336', 'name': 'volume-f93a7430-05dc-404c-a638-0c8af5542a28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '348d6fe3-0374-4084-ba2a-ee3b7578de28', 'enforce_multipath': True} {{(pid=84102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3cad0d-cc98-4e69-80f8-e1e0539fc5a8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:58 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-5f3d236b-a054-4e79-b8ab-c56c294e25be req-2aa9e1e9-175a-47cc-891a-54773e6fce62 tempest-DeleteServersTestJSON-773612904 None] attachment_update completed successfully.
Apr 29 08:34:58 devstack sudo[86889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73
Apr 29 08:34:58 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (7621b5e0-e10d-4114-8aea-cefcca112450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a63d78a-0239-4335-a62b-efa7c5c3c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a63d78a-0239-4335-a62b-efa7c5c3c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545471315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0eeae059-94ae-421b-949f-b2f367878427,host='devstack@QuobyteHD#QuobyteHD',id=d84d9240-3f53-4255-a970-3c5484bb07fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:59Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dd2620-7336-4044-9451-ed3a8ee366c2),volume_type_id=26dd2620-7336-4044-9451-ed3a8ee366c2)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c529f477-52c8-4ce8-8c3a-0a0e2f565237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c529f477-52c8-4ce8-8c3a-0a0e2f565237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af0fd16-c2d6-4d59-8b80-5c9741aa2cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af0fd16-c2d6-4d59-8b80-5c9741aa2cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84d9240-3f53-4255-a970-3c5484bb07fc', 'volume_name': 'volume-d84d9240-3f53-4255-a970-3c5484bb07fc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d20e3-e13a-4759-a43e-908f015d81c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48d20e3-e13a-4759-a43e-908f015d81c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5137b24-6177-41c2-b964-6a394db507a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:34:58 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Volume d84d9240-3f53-4255-a970-3c5484bb07fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84d9240-3f53-4255-a970-3c5484bb07fc', 'volume_size': 1}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:34:58 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" returned: 0 in 0.783s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:59 devstack sudo[86894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 1G
Apr 29 08:34:59 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:34:59 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root
Apr 29 08:34:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 1G" returned: 0 in 0.809s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:34:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:34:59 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769
Apr 29 08:34:59 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:00 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769" returned: 0 in 0.731s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:00 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:35:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:00 devstack sudo[86908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769
Apr 29 08:35:00 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:01 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769" returned: 0 in 0.658s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:01 devstack sudo[86911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info
Apr 29 08:35:01 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:02 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info" returned: 0 in 0.817s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:02 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:02 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info
Apr 29 08:35:02 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:02 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.info" returned: 0 in 0.774s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.088s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0eeae059-94ae-421b-949f-b2f367878427,created_at=2026-04-29T06:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1545471315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0eeae059-94ae-421b-949f-b2f367878427,host='devstack@QuobyteHD#QuobyteHD',id=d84d9240-3f53-4255-a970-3c5484bb07fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='279ca95a853e44dc84f94040d700e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:34:59Z,use_quota=True,user_id='6d098d4c170444019c2274a9972a0afc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26dd2620-7336-4044-9451-ed3a8ee366c2),volume_type_id=26dd2620-7336-4044-9451-ed3a8ee366c2)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Creating volume d84d9240-3f53-4255-a970-3c5484bb07fc {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:02 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:02 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc 1073741824
Apr 29 08:35:02 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f6d69cf6-4871-49ce-8c93-9664fc848776 tempest-GroupSnapshotsV319Test-725772124 None] group_snapshot dae2495e-4e5c-492d-9823-145084eea0e0: created successfully
Apr 29 08:35:03 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc 1073741824" returned: 0 in 1.078s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:04 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc
Apr 29 08:35:04 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] group_snapshot dae2495e-4e5c-492d-9823-145084eea0e0: deleting
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] group_snapshot dae2495e-4e5c-492d-9823-145084eea0e0: deleting {{(pid=84102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "cinder-quobyte-5e91638f-831f-4e9f-9eb4-ebb3eec6d769" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-5e91638f-831f-4e9f-9eb4-ebb3eec6d769" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Deleting offline snapshot 5e91638f-831f-4e9f-9eb4-ebb3eec6d769 of volume d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] snapshot_file for this snap is: volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30a70e5-0a6b-41c5-ade7-967590f592bc]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:05 devstack sudo[87005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769
Apr 29 08:35:05 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:05 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc" returned: 0 in 1.269s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] <== create_volume: return (2437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.441s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5137b24-6177-41c2-b964-6a394db507a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84d9240-3f53-4255-a970-3c5484bb07fc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490a7468-b1b9-4499-aa9e-032c14bbc7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:05 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Volume volume-d84d9240-3f53-4255-a970-3c5484bb07fc (d84d9240-3f53-4255-a970-3c5484bb07fc): created successfully
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490a7468-b1b9-4499-aa9e-032c14bbc7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Flow 'volume_create_manager' (7621b5e0-e10d-4114-8aea-cefcca112450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-468606e7-c1fa-4508-b393-469efd47d8da tempest-GroupsTest-322582594 None] Created volume successfully.
Apr 29 08:35:06 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769" returned: 0 in 1.154s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:35:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d835a29f-5536-46ba-901b-d2eead01200d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-635285c2-6501-4c53-a9d8-aa4f25ef833f tempest-GroupsTest-322582594 None] Update group completed successfully.
Apr 29 08:35:06 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73
Apr 29 08:35:06 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:07 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" returned: 0 in 1.041s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:07 devstack sudo[87019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769
Apr 29 08:35:07 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-9732bb77-bc1d-4747-a8da-49dd262e0c84 req-81d0570f-46a3-4f5d-bfd1-94fcc6130620 tempest-DeleteServersTestJSON-773612904 None] Terminate volume connection completed successfully.
Apr 29 08:35:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9732bb77-bc1d-4747-a8da-49dd262e0c84 req-81d0570f-46a3-4f5d-bfd1-94fcc6130620 tempest-DeleteServersTestJSON-773612904 None] Deleting attachment 348d6fe3-0374-4084-ba2a-ee3b7578de28. {{(pid=84102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:35:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4c437f25-359e-468c-9166-4e3f4ab73db4 tempest-GroupsTest-322582594 None] Update group completed successfully.
Apr 29 08:35:08 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769" returned: 0 in 0.849s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:08 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769
Apr 29 08:35:08 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:08 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73.5e91638f-831f-4e9f-9eb4-ebb3eec6d769" returned: 0 in 0.819s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-5e91638f-831f-4e9f-9eb4-ebb3eec6d769" released by "_delete_snapshot" :: held 4.146s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" released by "delete_snapshot" :: held 4.208s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:09 devstack cinder-volume[84102]: WARNING cinder.quota [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1680492436 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1680492436, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:09 devstack cinder-volume[84102]: WARNING cinder.quota [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1680492436 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1680492436, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:09 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] Created reservations ['1065ff75-8a06-4f60-a4cf-b84a9504f5e5', '1d227e81-bb53-4aca-86bb-1d567328c94d', '0169a18c-a620-4466-9f3f-c2a9e590899f', '0122b9c1-a097-4b12-a9b1-e05aabf43c10'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-717c1411-a175-485f-ae28-eadbfe6e76b2 tempest-GroupSnapshotsV319Test-725772124 None] group_snapshot dae2495e-4e5c-492d-9823-145084eea0e0: deleted successfully
Apr 29 08:35:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Acquiring lock "cinder-quobyte-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:09 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de809d54-c939-43a1-8784-609429956c51]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:09 devstack sudo[87094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf
Apr 29 08:35:09 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:10 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" returned: 0 in 0.861s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:10 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf
Apr 29 08:35:10 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[42029965-946d-47a3-98d3-ece258d20316]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:10 devstack sudo[87104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73
Apr 29 08:35:10 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:11 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" returned: 0 in 0.880s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-8e1c3ddb-e6af-4033-9c8b-d6ffde6648cf" released by "delete_volume" :: held 1.799s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Acquiring lock "cinder-quobyte-d84d9240-3f53-4255-a970-3c5484bb07fc" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "cinder-f93a7430-05dc-404c-a638-0c8af5542a28-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-d84d9240-3f53-4255-a970-3c5484bb07fc" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "cinder-f93a7430-05dc-404c-a638-0c8af5542a28-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca2496-ff6b-4656-9804-7d72e551288b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "cinder-quobyte-f93a7430-05dc-404c-a638-0c8af5542a28" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "cinder-quobyte-f93a7430-05dc-404c-a638-0c8af5542a28" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbffa10-1fc7-4437-b46f-f20483adfa74]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:11 devstack sudo[87114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc
Apr 29 08:35:11 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:11 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" returned: 0 in 0.961s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:11 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73
Apr 29 08:35:11 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:11 devstack sudo[87118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28
Apr 29 08:35:11 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:12 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" returned: 0 in 0.752s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Lock "cinder-quobyte-d213c5e4-8d04-48cc-ab8e-e2c80f7c6e73" released by "delete_volume" :: held 1.806s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:12 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc" returned: 0 in 1.026s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Created reservations ['fd0bd6b6-8e01-4fc7-bb66-176a19d43ab6'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:12 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc
Apr 29 08:35:12 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:12 devstack cinder-volume[84102]: WARNING cinder.quota [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1680492436 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1680492436, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Created reservations ['216df36c-f257-4051-b5b9-4993da9cbe31', '8bc8819c-e4ce-4c92-ab85-9c4349de3c8b', '5ff5f739-71bf-45c8-bca9-b90fb3148b92', '25bf9d31-8d6a-4018-97c9-5b67a1e9bebc'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=72,cinder:SELECT=86,cinder:DELETE=6,cinder:INSERT=14 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:12 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28" returned: 0 in 1.201s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:12 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:12 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:12 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28
Apr 29 08:35:12 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:13 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d84d9240-3f53-4255-a970-3c5484bb07fc" returned: 0 in 0.876s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "cinder-quobyte-d84d9240-3f53-4255-a970-3c5484bb07fc" released by "delete_volume" :: held 1.961s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=92,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=3 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Created reservations ['c6bc09f9-65c7-4aa5-baca-e98e02711e77'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:13 devstack cinder-volume[84102]: WARNING cinder.quota [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-724426238 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-724426238, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:13 devstack cinder-volume[84102]: WARNING cinder.quota [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-724426238 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-724426238, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Created reservations ['12b0c295-5767-4793-96b1-938c09e81f0e', '39f9def5-436a-4b56-911f-69c266f109e7', '001cdcfa-dafd-417b-93fc-8fdea402cee5', 'd7ae05f2-b2b8-4eb5-a03d-930cd1ac1be1'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:13 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.836s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d44838e3-2fff-4676-9776-cd259886c289 tempest-GroupSnapshotsV319Test-725772124 None] Delete group completed successfully.
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Created reservations ['fb1c0a83-472f-4e8f-924f-f030a030c235', 'a28b6888-4a22-46c7-8585-1470279cf7df', 'a4002c0c-9906-44ed-895e-34090c937903', '01d57416-9d0f-4219-bf85-e6f685341bd4'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:13 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f93a7430-05dc-404c-a638-0c8af5542a28" returned: 0 in 0.916s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "cinder-quobyte-f93a7430-05dc-404c-a638-0c8af5542a28" released by "delete_volume" :: held 2.181s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Created reservations ['27e7a29d-b03c-427e-9d6e-503ad1c3d7ea', '03d7c8c0-52bb-4788-aaaf-46c2966aaa12', '84271bf3-56c6-40aa-b276-03533e519db5', '4c9ff6f9-3e1c-4b52-a031-99336a59775e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:13 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:13 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:13 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:13 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:14 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.805s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:14 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-645e32ca-2a56-4aa5-b967-bb518912df29 tempest-GroupsTest-322582594 None] Delete group completed successfully.
Apr 29 08:35:14 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.795s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:14 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Deleted volume successfully.
Apr 29 08:35:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53e3d5cf-b221-4e63-ac89-c34a5ca64702 tempest-DeleteServersTestJSON-773612904 None] Lock "cinder-f93a7430-05dc-404c-a638-0c8af5542a28-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:16 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:16 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:17 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.862s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3f0b9f0e-699f-47ed-8107-16ae97e1a7aa tempest-GroupsV320Test-594435340 None] Group tempest-GroupsV320Test-Group-1868500131: creating
Apr 29 08:35:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3f0b9f0e-699f-47ed-8107-16ae97e1a7aa tempest-GroupsV320Test-594435340 None] Group tempest-GroupsV320Test-Group-1868500131: created successfully
Apr 29 08:35:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3f0b9f0e-699f-47ed-8107-16ae97e1a7aa tempest-GroupsV320Test-594435340 None] Create group completed successfully.
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Created reservations ['6fa9da63-7533-4d0f-abee-46fd25aea5b3'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:24 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:24 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:25 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.681s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:25 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-425b8294-8e4f-4f31-8666-cab1a1eb9802 tempest-GroupsV320Test-594435340 None] Delete group completed successfully.
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Flow 'volume_create_manager' (e50e6d6d-6ea9-4cac-9d23-8ed73f1c10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730af073-fea2-4889-8eec-3deb08cec734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730af073-fea2-4889-8eec-3deb08cec734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551227643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3685c3e-933f-4143-a9e9-b08dcf0ad63a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4105af505f14d39aa74150bf3234dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:25Z,use_quota=True,user_id='3407516bf93a49a7865b18aab8e74ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b6410-3552-4d80-96ea-9d2b80bb94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362b6410-3552-4d80-96ea-9d2b80bb94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3a273a-7fdd-4200-99d6-725f8f4830a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3a273a-7fdd-4200-99d6-725f8f4830a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3685c3e-933f-4143-a9e9-b08dcf0ad63a', 'volume_name': 'volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cef114c-daea-4ab1-8625-ff24038743e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cef114c-daea-4ab1-8625-ff24038743e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30e7bcf-5a12-4471-b171-3d99437a7d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Volume e3685c3e-933f-4143-a9e9-b08dcf0ad63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a', 'volume_size': 1}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551227643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3685c3e-933f-4143-a9e9-b08dcf0ad63a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4105af505f14d39aa74150bf3234dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:25Z,use_quota=True,user_id='3407516bf93a49a7865b18aab8e74ca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Creating volume e3685c3e-933f-4143-a9e9-b08dcf0ad63a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:25 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:25 devstack sudo[87178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a 1073741824
Apr 29 08:35:25 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:26 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a 1073741824" returned: 0 in 0.872s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:26 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a
Apr 29 08:35:26 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:27 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" returned: 0 in 1.313s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30e7bcf-5a12-4471-b171-3d99437a7d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bfe40a-2ff0-476f-a1e6-252626ed369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:27 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Volume volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a (e3685c3e-933f-4143-a9e9-b08dcf0ad63a): created successfully
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bfe40a-2ff0-476f-a1e6-252626ed369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Flow 'volume_create_manager' (e50e6d6d-6ea9-4cac-9d23-8ed73f1c10db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-5cc2c0df-5fb9-4390-81d2-2606d2a02625 req-a16dd5d3-f13b-44b4-a872-69e2a9ee63e6 tempest-VolumesGetTestJSON-1141342404 None] Created volume successfully.
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Flow 'volume_create_manager' (9ce3b906-b157-418c-81b9-819325555be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ab11f-4b38-4f13-bcb8-6dd7a42621fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4ab11f-4b38-4f13-bcb8-6dd7a42621fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-348421127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2587d656-deb8-4615-b68b-5700d00d7585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c995a1421b504ad88aba435f347bd652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:29Z,use_quota=True,user_id='3320cab0ed5440d5bd401cb190ee6fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ff88e5-a8d6-4f54-a5c5-a87845a96e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ff88e5-a8d6-4f54-a5c5-a87845a96e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03dfa90-e022-4f98-b0df-f043fd84950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03dfa90-e022-4f98-b0df-f043fd84950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2587d656-deb8-4615-b68b-5700d00d7585', 'volume_name': 'volume-2587d656-deb8-4615-b68b-5700d00d7585', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fedb4-e0a8-453e-bbe5-43928e7a5aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2fedb4-e0a8-453e-bbe5-43928e7a5aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c0bd50-0e65-4ced-92c9-8fb804c6b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Volume 2587d656-deb8-4615-b68b-5700d00d7585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2587d656-deb8-4615-b68b-5700d00d7585', 'volume_size': 1}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-348421127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2587d656-deb8-4615-b68b-5700d00d7585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c995a1421b504ad88aba435f347bd652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:29Z,use_quota=True,user_id='3320cab0ed5440d5bd401cb190ee6fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Creating volume 2587d656-deb8-4615-b68b-5700d00d7585 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:28 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:29 devstack sudo[87226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 1073741824
Apr 29 08:35:29 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Acquiring lock "cinder-e3685c3e-933f-4143-a9e9-b08dcf0ad63a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "cinder-e3685c3e-933f-4143-a9e9-b08dcf0ad63a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Acquiring lock "cinder-quobyte-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "cinder-quobyte-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" acquired by "delete_volume" :: waited 0.044s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a94680-8c1f-491f-aa20-bb8d0397c6d4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:30 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a
Apr 29 08:35:30 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:30 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 1073741824" returned: 0 in 1.558s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:30 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585
Apr 29 08:35:30 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:31 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" returned: 0 in 1.203s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:31 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a
Apr 29 08:35:31 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:31 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585" returned: 0 in 0.967s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.607s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c0bd50-0e65-4ced-92c9-8fb804c6b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2587d656-deb8-4615-b68b-5700d00d7585', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b1c44-7c0b-4424-b876-b3fd57fb6712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:31 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Volume volume-2587d656-deb8-4615-b68b-5700d00d7585 (2587d656-deb8-4615-b68b-5700d00d7585): created successfully
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b1c44-7c0b-4424-b876-b3fd57fb6712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Flow 'volume_create_manager' (9ce3b906-b157-418c-81b9-819325555be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3c56c4de-6abf-447b-9fc3-0480ac75b1c4 tempest-VolumesServicesTestJSON-1827569770 None] Created volume successfully.
Apr 29 08:35:32 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" returned: 0 in 1.002s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "cinder-quobyte-e3685c3e-933f-4143-a9e9-b08dcf0ad63a" released by "delete_volume" :: held 2.300s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.quota [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Created reservations ['1311de25-5678-4833-991f-1380f4be8843', 'f4f647b8-08f8-43ec-9b5c-ad19ae8a34f5', 'eb09a778-03a7-47fe-8954-ef964d9b47e5', '7c7c2068-3ddc-4fe4-844f-49a88cc9820e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Acquiring lock "cinder-2587d656-deb8-4615-b68b-5700d00d7585-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "cinder-2587d656-deb8-4615-b68b-5700d00d7585-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:32 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:32 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Acquiring lock "cinder-quobyte-2587d656-deb8-4615-b68b-5700d00d7585" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "cinder-quobyte-2587d656-deb8-4615-b68b-5700d00d7585" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f147399-cea1-4534-a0da-1447c8369a87]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:32 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585
Apr 29 08:35:32 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:33 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.036s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:33 devstack cinder-volume[84102]: DEBUG cinder.manager [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:33 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Deleted volume successfully.
Apr 29 08:35:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-5a0574e3-dc86-4173-8ba7-aa6a0748e2ee req-c1752219-f712-4816-b8df-c8565ca7bcdb tempest-VolumesGetTestJSON-1141342404 None] Lock "cinder-e3685c3e-933f-4143-a9e9-b08dcf0ad63a-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:33 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585" returned: 0 in 1.223s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:33 devstack sudo[87252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585
Apr 29 08:35:33 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:34 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2587d656-deb8-4615-b68b-5700d00d7585" returned: 0 in 0.996s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "cinder-quobyte-2587d656-deb8-4615-b68b-5700d00d7585" released by "delete_volume" :: held 2.318s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Created reservations ['e2019a76-38fe-473e-bcb2-f231dfb13387', 'd869c483-0318-4ca9-abb9-b1edd3b7bdf3', '470ef368-8e62-462b-b218-52f52c0a6ad0', 'e3f4a85b-d990-4d2b-9230-ea672be7dd8e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:35 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:35 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:36 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.136s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:36 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Deleted volume successfully.
Apr 29 08:35:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ea8ed13-c4ed-4f93-abe6-10de82bb1404 tempest-VolumesServicesTestJSON-1827569770 None] Lock "cinder-2587d656-deb8-4615-b68b-5700d00d7585-delete_volume" released by "delete_volume" :: held 3.854s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (b8ca56d5-6256-4fb7-b042-e18c96d74fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b16b7a-fc89-40fa-ae4e-712906eaf660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b16b7a-fc89-40fa-ae4e-712906eaf660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-684611409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ec466-4987-4ed9-848f-f5165615e8d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:42Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74403cd9-8f94-4670-ba12-ea7291c8837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74403cd9-8f94-4670-ba12-ea7291c8837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5edfbf0-fe5f-4236-bba4-ef7a5f72eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5edfbf0-fe5f-4236-bba4-ef7a5f72eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371ec466-4987-4ed9-848f-f5165615e8d3', 'volume_name': 'volume-371ec466-4987-4ed9-848f-f5165615e8d3', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a3b728-5dbe-4e92-bec9-9d18999de249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a3b728-5dbe-4e92-bec9-9d18999de249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7667c31-1b74-4d7a-8257-37807d54fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:41 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Volume 371ec466-4987-4ed9-848f-f5165615e8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371ec466-4987-4ed9-848f-f5165615e8d3', 'volume_size': 1}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-684611409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ec466-4987-4ed9-848f-f5165615e8d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:42Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Creating volume 371ec466-4987-4ed9-848f-f5165615e8d3 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:41 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:41 devstack sudo[87334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 1073741824
Apr 29 08:35:41 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:43 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 1073741824" returned: 0 in 1.090s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:43 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3
Apr 29 08:35:43 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:43 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3" returned: 0 in 0.810s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7667c31-1b74-4d7a-8257-37807d54fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371ec466-4987-4ed9-848f-f5165615e8d3', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d092da-ee14-458e-adab-6eb614342920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:43 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Volume volume-371ec466-4987-4ed9-848f-f5165615e8d3 (371ec466-4987-4ed9-848f-f5165615e8d3): created successfully
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d092da-ee14-458e-adab-6eb614342920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (b8ca56d5-6256-4fb7-b042-e18c96d74fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:43 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2feb7f74-6bac-42f0-8d25-3c472fdd8310 tempest-VolumesTestJSON-19016617 None] Created volume successfully.
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (3f0b910c-61c6-444d-99b4-bef04cb08617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1752e70a-9a68-4d1f-9f32-7f23f9c76af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1752e70a-9a68-4d1f-9f32-7f23f9c76af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134097176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97d9ed3-07bd-49c4-833e-c9952a6bdd79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:46Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafeb13-bcb6-4c89-9e53-3f4a841644c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfafeb13-bcb6-4c89-9e53-3f4a841644c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c5dff-1258-4d08-be3a-9dbaf3089dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c5dff-1258-4d08-be3a-9dbaf3089dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f97d9ed3-07bd-49c4-833e-c9952a6bdd79', 'volume_name': 'volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647b256b-0cee-4bbf-b413-7461df194c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647b256b-0cee-4bbf-b413-7461df194c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaec0bc-d6b6-4e36-a35e-63183ac69405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Volume f97d9ed3-07bd-49c4-833e-c9952a6bdd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79', 'volume_size': 1}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134097176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97d9ed3-07bd-49c4-833e-c9952a6bdd79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:46Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Creating volume f97d9ed3-07bd-49c4-833e-c9952a6bdd79 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:45 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:45 devstack sudo[87347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 1073741824
Apr 29 08:35:45 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Flow 'volume_create_manager' (d7f70dc6-016f-4af5-9ed1-d9146a37e0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e1b38a-b4ca-4d18-a4ce-bdf9d85c1d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e1b38a-b4ca-4d18-a4ce-bdf9d85c1d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2128096685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a424ed-3981-453e-a899-c18824157aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3e4202c46d4782bb9245b7a1923c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:46Z,use_quota=True,user_id='b03e60e1513e435bbb7a73f67548ec4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2844394-5bff-487f-9d09-a19d5861c46a),volume_type_id=e2844394-5bff-487f-9d09-a19d5861c46a)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b413028-d131-4158-88b3-8bb9ed4fdaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b413028-d131-4158-88b3-8bb9ed4fdaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791b69cf-d700-46f2-a007-a54f88376e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791b69cf-d700-46f2-a007-a54f88376e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a424ed-3981-453e-a899-c18824157aaf', 'volume_name': 'volume-34a424ed-3981-453e-a899-c18824157aaf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fba9a-32b4-403f-9b54-e544db66d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fba9a-32b4-403f-9b54-e544db66d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe28f94-bd11-4ce5-81a1-60c576969442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:45 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Volume 34a424ed-3981-453e-a899-c18824157aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a424ed-3981-453e-a899-c18824157aaf', 'volume_size': 1}
Apr 29 08:35:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:46 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 1073741824" returned: 0 in 0.954s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:46 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79
Apr 29 08:35:46 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:47 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" returned: 0 in 0.685s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2128096685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a424ed-3981-453e-a899-c18824157aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed3e4202c46d4782bb9245b7a1923c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:46Z,use_quota=True,user_id='b03e60e1513e435bbb7a73f67548ec4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2844394-5bff-487f-9d09-a19d5861c46a),volume_type_id=e2844394-5bff-487f-9d09-a19d5861c46a)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Creating volume 34a424ed-3981-453e-a899-c18824157aaf {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:47 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaec0bc-d6b6-4e36-a35e-63183ac69405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7b3c1-62a1-4252-963a-2b98b392394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:47 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf 1073741824
Apr 29 08:35:47 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:47 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Volume volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 (f97d9ed3-07bd-49c4-833e-c9952a6bdd79): created successfully
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1a7b3c1-62a1-4252-963a-2b98b392394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (3f0b910c-61c6-444d-99b4-bef04cb08617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f7a326f5-4d49-492a-9395-d59adaacf19c tempest-VolumesTestJSON-19016617 None] Created volume successfully.
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (8965bb88-dd0f-4762-9a05-c411d06a17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620b974-9eab-4f48-98fe-202979ff8ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620b974-9eab-4f48-98fe-202979ff8ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1820795155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5738a3e5-1ba0-4f56-9459-c19dd2595f47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:49Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ec221-88c1-4659-9222-c21e8868f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5ec221-88c1-4659-9222-c21e8868f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed50f59-4ac2-4347-9f3b-3aac17b2ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed50f59-4ac2-4347-9f3b-3aac17b2ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5738a3e5-1ba0-4f56-9459-c19dd2595f47', 'volume_name': 'volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7001fc2-393b-4b44-b948-1aa716c7beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7001fc2-393b-4b44-b948-1aa716c7beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec074995-84bc-4ff1-8770-758a276c315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:48 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Volume 5738a3e5-1ba0-4f56-9459-c19dd2595f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47', 'volume_size': 1}
Apr 29 08:35:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:49 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf 1073741824" returned: 0 in 1.615s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:49 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf
Apr 29 08:35:49 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:50 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf" returned: 0 in 0.946s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.643s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1820795155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5738a3e5-1ba0-4f56-9459-c19dd2595f47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='984efb1f66d54a758ca571a56152dbc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:49Z,use_quota=True,user_id='993a55d0d023468f8ffa929fa36b3011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Creating volume 5738a3e5-1ba0-4f56-9459-c19dd2595f47 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:50 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:50 devstack sudo[87367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 1073741824
Apr 29 08:35:50 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe28f94-bd11-4ce5-81a1-60c576969442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a424ed-3981-453e-a899-c18824157aaf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a1002-f5cf-443f-a9ac-42d20745ac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:50 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Volume volume-34a424ed-3981-453e-a899-c18824157aaf (34a424ed-3981-453e-a899-c18824157aaf): created successfully
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57a1002-f5cf-443f-a9ac-42d20745ac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Flow 'volume_create_manager' (d7f70dc6-016f-4af5-9ed1-d9146a37e0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:50 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7b2fe3e8-4eff-4323-801b-cf42c01fd4d5 tempest-VolumeTypesAccessTest-1045354916 None] Created volume successfully.
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Flow 'volume_create_manager' (a4b86c58-35fd-4aed-a585-1bbc37e71724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf97643-dcbf-49e3-bb97-e74ebd23e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Acquiring lock "cinder-34a424ed-3981-453e-a899-c18824157aaf-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf97643-dcbf-49e3-bb97-e74ebd23e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758c73e6-c88e-4449-9b55-38dbc58f5237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd493ed0091f45c9b46e78f933e2b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:51Z,use_quota=True,user_id='6bd2e1809aee460d8e9ab9486db239e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461ea4a8-1bca-467b-810a-46207bb98995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (461ea4a8-1bca-467b-810a-46207bb98995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36d175e-cddd-453d-a8d4-7bb81cc9e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.image.glance [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Creating Keystone auth plugin from conf {{(pid=84102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "cinder-34a424ed-3981-453e-a899-c18824157aaf-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Acquiring lock "cinder-quobyte-34a424ed-3981-453e-a899-c18824157aaf" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "cinder-quobyte-34a424ed-3981-453e-a899-c18824157aaf" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc8ead-8bfd-4c5e-9220-04b20d1a6aeb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:51 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 1073741824" returned: 0 in 1.499s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:51 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf
Apr 29 08:35:51 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:51 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47
Apr 29 08:35:51 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36d175e-cddd-453d-a8d4-7bb81cc9e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '758c73e6-c88e-4449-9b55-38dbc58f5237', 'volume_name': 'volume-758c73e6-c88e-4449-9b55-38dbc58f5237', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478edfc50>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fde081-b2a5-4c01-add7-6a5e826cd835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fde081-b2a5-4c01-add7-6a5e826cd835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e7529f-57d9-4287-aa60-57c126fdfc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:52 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume 758c73e6-c88e-4449-9b55-38dbc58f5237: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-758c73e6-c88e-4449-9b55-38dbc58f5237', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478edfc50>}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Trying to clone 758c73e6-c88e-4449-9b55-38dbc58f5237 from image 000942db-1254-4464-b86b-8409e1be6077 at location (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]). {{(pid=84102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 08:35:52 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47" returned: 0 in 0.939s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec074995-84bc-4ff1-8770-758a276c315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43f7adf-99dc-46d1-ab48-8c23e137a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:52 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf" returned: 0 in 1.228s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:52 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Volume volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 (5738a3e5-1ba0-4f56-9459-c19dd2595f47): created successfully
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43f7adf-99dc-46d1-ab48-8c23e137a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Flow 'volume_create_manager' (8965bb88-dd0f-4762-9a05-c411d06a17cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:52 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf
Apr 29 08:35:52 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-132c4ad2-3b35-41c5-bef2-df908ec325dd tempest-VolumesTestJSON-19016617 None] Created volume successfully.
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:35:53 devstack cinder-volume[84102]: INFO cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6abe4-cb98-4931-bb56-f305bcece568]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:53 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD
Apr 29 08:35:53 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:53 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-34a424ed-3981-453e-a899-c18824157aaf" returned: 0 in 1.026s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "cinder-quobyte-34a424ed-3981-453e-a899-c18824157aaf" released by "delete_volume" :: held 2.344s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:53 devstack cinder-volume[84102]: WARNING cinder.quota [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1141177833 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1141177833, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:53 devstack cinder-volume[84102]: WARNING cinder.quota [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1141177833 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1141177833, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:35:53 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Created reservations ['e5d110ad-d092-415a-a83b-c9962d564a0a', '4208f82e-9ae8-47c2-aad2-54425b125158', 'd9a9e0ac-5845-4409-9dff-914f014ca478', 'f449a314-a66f-4de5-8d5d-c0046518bbb9'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:54 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:54 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:54 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD" returned: 0 in 1.176s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 is fetched for user 6bd2e1809aee460d8e9ab9486db239e6. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4863d607-7c1d-4f2b-8f0b-28f2b7fdd2c5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Flow 'volume_create_manager' (52607bcf-0702-4f89-bcbb-502839ebcdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add1df2d-bd06-4523-b3bf-9c808def5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add1df2d-bd06-4523-b3bf-9c808def5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1312877251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526f4264-e09e-452d-bcdf-9133f48e04bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f09e22280454382f0ecf2bba715ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:54Z,use_quota=True,user_id='ef191cb35267409c884c44df362cfee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c14b93-d34c-42e4-8169-55206eae9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c14b93-d34c-42e4-8169-55206eae9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bdfc1f-c9ac-48ac-a674-01cf70c36d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bdfc1f-c9ac-48ac-a674-01cf70c36d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526f4264-e09e-452d-bcdf-9133f48e04bf', 'volume_name': 'volume-526f4264-e09e-452d-bcdf-9133f48e04bf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:54 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD
Apr 29 08:35:54 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2d3c1-1545-4404-91f5-acd92c103ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2d3c1-1545-4404-91f5-acd92c103ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3b0945-d9d0-4bea-bdaa-fee19dfaa62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume 526f4264-e09e-452d-bcdf-9133f48e04bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526f4264-e09e-452d-bcdf-9133f48e04bf', 'volume_size': 1}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1312877251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=526f4264-e09e-452d-bcdf-9133f48e04bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f09e22280454382f0ecf2bba715ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:54Z,use_quota=True,user_id='ef191cb35267409c884c44df362cfee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Creating volume 526f4264-e09e-452d-bcdf-9133f48e04bf {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:54 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-5738a3e5-1ba0-4f56-9459-c19dd2595f47-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "cinder-5738a3e5-1ba0-4f56-9459-c19dd2595f47-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:54 devstack sudo[87453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf 1073741824
Apr 29 08:35:54 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-quobyte-5738a3e5-1ba0-4f56-9459-c19dd2595f47" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-5738a3e5-1ba0-4f56-9459-c19dd2595f47" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c276e5-bcc7-44e1-9570-846bfe1f123d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:54 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.893s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:54 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Deleted volume successfully.
Apr 29 08:35:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0426c99b-e7ff-41f4-ba2f-b394323dd4cc tempest-VolumeTypesAccessTest-1045354916 None] Lock "cinder-34a424ed-3981-453e-a899-c18824157aaf-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:54 devstack sudo[87456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47
Apr 29 08:35:54 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:55 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD" returned: 0 in 0.883s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:55 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf 1073741824" returned: 0 in 1.080s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:55 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47" returned: 0 in 0.935s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:55 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf
Apr 29 08:35:55 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:55 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47
Apr 29 08:35:55 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:56 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5738a3e5-1ba0-4f56-9459-c19dd2595f47" returned: 0 in 0.618s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-5738a3e5-1ba0-4f56-9459-c19dd2595f47" released by "delete_volume" :: held 1.617s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:56 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf" returned: 0 in 0.669s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.071s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:35:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758c73e6-c88e-4449-9b55-38dbc58f5237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd493ed0091f45c9b46e78f933e2b43f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:35:51Z,use_quota=True,user_id='6bd2e1809aee460d8e9ab9486db239e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Creating volume 758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:35:56 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:56 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1073741824
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3b0945-d9d0-4bea-bdaa-fee19dfaa62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526f4264-e09e-452d-bcdf-9133f48e04bf', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:56 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4632ee-0b3b-403e-ae3a-e7a2408753aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:35:56 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume volume-526f4264-e09e-452d-bcdf-9133f48e04bf (526f4264-e09e-452d-bcdf-9133f48e04bf): created successfully
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4632ee-0b3b-403e-ae3a-e7a2408753aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Flow 'volume_create_manager' (52607bcf-0702-4f89-bcbb-502839ebcdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:35:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f3ee593f-4517-472d-9203-8fec8583b9cb tempest-VolumeQuotasAdminTestJSON-1601569535 None] Created volume successfully.
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Created reservations ['114c9a98-fc33-4350-9b33-57954140be73', 'e11d5072-1a1c-4893-a29b-a44e320819c4', '2fdbbb5a-5d54-480b-b4e5-03a9b1af1572', '271e386a-f477-444d-9d78-e1981fd9a952'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:56 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:56 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "cinder-526f4264-e09e-452d-bcdf-9133f48e04bf-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "cinder-526f4264-e09e-452d-bcdf-9133f48e04bf-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "cinder-quobyte-526f4264-e09e-452d-bcdf-9133f48e04bf" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "cinder-quobyte-526f4264-e09e-452d-bcdf-9133f48e04bf" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-f97d9ed3-07bd-49c4-833e-c9952a6bdd79-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3b824-1b11-43bd-898d-96d1c83cb0e2]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "cinder-f97d9ed3-07bd-49c4-833e-c9952a6bdd79-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-quobyte-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d14fa-3ddf-4980-ade9-76e3b43b4fb1]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:57 devstack sudo[87479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf
Apr 29 08:35:57 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:57 devstack sudo[87481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79
Apr 29 08:35:57 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:57 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.001s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:35:57 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Deleted volume successfully.
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96211d8e-d91f-4dbb-8400-51d1f7e2ba83 tempest-VolumesTestJSON-19016617 None] Lock "cinder-5738a3e5-1ba0-4f56-9459-c19dd2595f47-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:57 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1073741824" returned: 0 in 1.361s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:57 devstack sudo[87487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:35:57 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:58 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf" returned: 0 in 1.131s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:58 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" returned: 0 in 0.955s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:58 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf
Apr 29 08:35:58 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:58 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79
Apr 29 08:35:58 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:58 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 0.782s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Attempting download of 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume 758c73e6-c88e-4449-9b55-38dbc58f5237. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b754f82-8ac6-450b-b5ab-13fff496f0fd]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:58 devstack sudo[87500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x
Apr 29 08:35:58 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-526f4264-e09e-452d-bcdf-9133f48e04bf" returned: 0 in 0.878s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "cinder-quobyte-526f4264-e09e-452d-bcdf-9133f48e04bf" released by "delete_volume" :: held 2.097s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:59 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" returned: 0 in 0.877s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-f97d9ed3-07bd-49c4-833e-c9952a6bdd79" released by "delete_volume" :: held 1.903s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Created reservations ['270ac520-e168-4c19-a5ff-2c5b9cf98f65', '4e3b292a-0fdc-4006-a176-f4fe826eda33', 'c2db75ef-d0a5-4862-bde2-4147f4b2b9de', '27a66731-9df0-4c91-9c43-a460d4766185'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Created reservations ['f819f0bb-cc42-4304-9110-4e0cbb5f4428', '62d45283-2682-4125-a258-434986e5279c', '1880d10b-9c2b-4863-81e2-9e1228630e6a', '82e570be-6302-43c7-b9c0-937fbd77c11b'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:59 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack sudo[87506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:35:59 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-371ec466-4987-4ed9-848f-f5165615e8d3-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "cinder-371ec466-4987-4ed9-848f-f5165615e8d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Acquiring lock "cinder-quobyte-371ec466-4987-4ed9-848f-f5165615e8d3" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-371ec466-4987-4ed9-848f-f5165615e8d3" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d59ff2-c78d-4ffb-8c64-475ce069a5db]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:35:59 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3
Apr 29 08:35:59 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:35:59 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x" returned: 0 in 1.143s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:35:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:00 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x
Apr 29 08:36:00 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:00 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.967s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Deleted volume successfully.
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4b5ee8f-1428-458d-b292-898734636025 tempest-VolumesTestJSON-19016617 None] Lock "cinder-f97d9ed3-07bd-49c4-833e-c9952a6bdd79-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:00 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.191s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Deleted volume successfully.
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2c6d5ae9-75b1-4cc2-adf9-7676f6a3aa6f tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "cinder-526f4264-e09e-452d-bcdf-9133f48e04bf-delete_volume" released by "delete_volume" :: held 3.638s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:00 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3" returned: 0 in 1.165s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:00 devstack sudo[87521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3
Apr 29 08:36:00 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Flow 'volume_create_manager' (a0bfb293-6bc3-4c28-aba9-a125574c8e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c71d6cd-c534-4b1a-a70c-4d53574a4367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c71d6cd-c534-4b1a-a70c-4d53574a4367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-900885273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd5e42c-37f1-40fc-8437-7a67306f47ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f09e22280454382f0ecf2bba715ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:01Z,use_quota=True,user_id='ef191cb35267409c884c44df362cfee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedb7261-7dff-43f8-aee6-ee75e552aaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedb7261-7dff-43f8-aee6-ee75e552aaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b215d5-c574-4418-b928-cfc19508da0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b215d5-c574-4418-b928-cfc19508da0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd5e42c-37f1-40fc-8437-7a67306f47ca', 'volume_name': 'volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675ecc9-ecb8-44a7-84de-b993b9672876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675ecc9-ecb8-44a7-84de-b993b9672876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab21d26-5751-4ac9-a5fd-132eef65ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume 3bd5e42c-37f1-40fc-8437-7a67306f47ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca', 'volume_size': 1}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-900885273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd5e42c-37f1-40fc-8437-7a67306f47ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8f09e22280454382f0ecf2bba715ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:01Z,use_quota=True,user_id='ef191cb35267409c884c44df362cfee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Creating volume 3bd5e42c-37f1-40fc-8437-7a67306f47ca {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:00 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca 1073741824
Apr 29 08:36:01 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x" returned: 1 in 1.199s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_e0_0bq1x' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[218638d8-2b47-4ea5-a842-c9c9951db48b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD
Apr 29 08:36:01 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-371ec466-4987-4ed9-848f-f5165615e8d3" returned: 0 in 0.809s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "cinder-quobyte-371ec466-4987-4ed9-848f-f5165615e8d3" released by "delete_volume" :: held 2.133s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Created reservations ['bd87a467-1b45-4513-afda-dd698d572ed6', '0d713a62-d611-403e-b2f0-e44eb21a86e4', '0b868f6b-18d1-4a84-b73a-d431f09a605d', '52dc210b-4899-46b2-bdb7-af5b50aa8b0c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:01 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:01 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] 000942db-1254-4464-b86b-8409e1be6077 was qcow2, converting to raw {{(pid=84102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:36:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:01 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:01 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:02 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca 1073741824" returned: 0 in 1.205s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:02 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca
Apr 29 08:36:02 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:02 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.699s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:02 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Deleted volume successfully.
Apr 29 08:36:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bd7b19f9-87ed-40de-92a4-4bef507b74bc tempest-VolumesTestJSON-19016617 None] Lock "cinder-371ec466-4987-4ed9-848f-f5165615e8d3-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:03 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca" returned: 0 in 0.897s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab21d26-5751-4ac9-a5fd-132eef65ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d984c8b-e7e4-4b4e-8d9d-f4119cc49de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:03 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Volume volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca (3bd5e42c-37f1-40fc-8437-7a67306f47ca): created successfully
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d984c8b-e7e4-4b4e-8d9d-f4119cc49de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Flow 'volume_create_manager' (a0bfb293-6bc3-4c28-aba9-a125574c8e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-95334d1e-275a-4615-9aaa-a7eaf7b70326 tempest-VolumeQuotasAdminTestJSON-1601569535 None] Created volume successfully.
Apr 29 08:36:04 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 2.534s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:04 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_94bn3awqdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:36:04 devstack cinder-volume[84102]: INFO cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Converted 112.00 MB image at 44.18 MB/s
Apr 29 08:36:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:04 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1G
Apr 29 08:36:04 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-77b0aef7-80e1-49f0-a59d-8e0f06a9ad34 tempest-VolumeQuotasAdminTestJSON-1474151519 None] Transfer volume completed successfully.
Apr 29 08:36:05 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 1G" returned: 0 in 0.839s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:05 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[947eb2ba-5a4b-4c05-a8dc-60cb754a333f]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:05 devstack sudo[87559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:05 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:06 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Acquiring lock "cinder-3bd5e42c-37f1-40fc-8437-7a67306f47ca-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 0.996s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "cinder-3bd5e42c-37f1-40fc-8437-7a67306f47ca-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Acquiring lock "cinder-quobyte-3bd5e42c-37f1-40fc-8437-7a67306f47ca" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "cinder-quobyte-3bd5e42c-37f1-40fc-8437-7a67306f47ca" acquired by "delete_volume" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:06 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:06 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b5aa36-919f-40c3-b626-ecb4a35ea6ab]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:06 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca
Apr 29 08:36:06 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:07 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 1 in 1.032s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Downloaded image 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume 758c73e6-c88e-4449-9b55-38dbc58f5237 successfully. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 for user 6bd2e1809aee460d8e9ab9486db239e6 is deleted. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Marking volume 758c73e6-c88e-4449-9b55-38dbc58f5237 as bootable. {{(pid=84102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Copying metadata from image 000942db-1254-4464-b86b-8409e1be6077 to 758c73e6-c88e-4449-9b55-38dbc58f5237. {{(pid=84102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Creating volume glance metadata for volume 758c73e6-c88e-4449-9b55-38dbc58f5237 backed by image 000942db-1254-4464-b86b-8409e1be6077 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e7529f-57d9-4287-aa60-57c126fdfc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-758c73e6-c88e-4449-9b55-38dbc58f5237', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478edfc50>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9afe2fb-0cca-46e7-85cb-4d21dd5b5e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:07 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Volume volume-758c73e6-c88e-4449-9b55-38dbc58f5237 (758c73e6-c88e-4449-9b55-38dbc58f5237): created successfully
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9afe2fb-0cca-46e7-85cb-4d21dd5b5e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Flow 'volume_create_manager' (a4b86c58-35fd-4aed-a585-1bbc37e71724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-d6ff80fd-7ffe-4833-98d4-492005078e65 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Created volume successfully.
Apr 29 08:36:07 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca" returned: 0 in 1.096s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:07 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca
Apr 29 08:36:07 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7d7b4b85-1f48-4827-a890-4f5fc44fd382 tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-530401518: creating
Apr 29 08:36:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7d7b4b85-1f48-4827-a890-4f5fc44fd382 tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-530401518: created successfully
Apr 29 08:36:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7d7b4b85-1f48-4827-a890-4f5fc44fd382 tempest-GroupSnapshotsTest-1510866578 None] Create group completed successfully.
Apr 29 08:36:08 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3bd5e42c-37f1-40fc-8437-7a67306f47ca" returned: 0 in 0.710s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "cinder-quobyte-3bd5e42c-37f1-40fc-8437-7a67306f47ca" released by "delete_volume" :: held 1.906s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Created reservations ['3a7f9bc7-ac93-46bd-970b-0769d5884bf0', 'a42d4163-9188-4c7b-8cb6-f699836d23c1', '92908e75-0f84-4932-b510-c1a008e1ef37', '5695e374-5e31-487c-a78b-2bb52dcad935'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:08 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:08 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:09 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Deleted volume successfully.
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a204f0de-c1bd-41e1-bc6e-2bc32ed5cd09 tempest-VolumeQuotasAdminTestJSON-348142332 None] Lock "cinder-3bd5e42c-37f1-40fc-8437-7a67306f47ca-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (22df6dce-3d4c-46b9-ad00-0530e415116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ed226d-96fd-4fbc-91aa-8d19dbf9af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ed226d-96fd-4fbc-91aa-8d19dbf9af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1270364410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdbf46c-92c5-4719-9e10-2aee66213b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdc703851384c7d877616c3c7856e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:09Z,use_quota=True,user_id='834be5b9b872416fa058c4085a88be4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a795d5-9c44-47ba-ac90-6d99b7dd6f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a795d5-9c44-47ba-ac90-6d99b7dd6f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9146161-958a-4cd1-b2ff-696e329bd29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9146161-958a-4cd1-b2ff-696e329bd29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdbf46c-92c5-4719-9e10-2aee66213b77', 'volume_name': 'volume-5fdbf46c-92c5-4719-9e10-2aee66213b77', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf32898-71df-41ee-8e14-fea0a85d5ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf32898-71df-41ee-8e14-fea0a85d5ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ac9ca7-107f-4cd0-99db-4ac56b0f2d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Volume 5fdbf46c-92c5-4719-9e10-2aee66213b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdbf46c-92c5-4719-9e10-2aee66213b77', 'volume_size': 1}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1270364410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fdbf46c-92c5-4719-9e10-2aee66213b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdc703851384c7d877616c3c7856e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:09Z,use_quota=True,user_id='834be5b9b872416fa058c4085a88be4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Creating volume 5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:09 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:09 devstack sudo[87579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 1073741824
Apr 29 08:36:09 devstack sudo[87579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (ab937685-e392-458f-8f0b-e3b31c6d79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b461b8da-eac1-4111-84e3-5a371dadf4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b461b8da-eac1-4111-84e3-5a371dadf4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166220663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2e9538f-aa40-4e48-aead-7382f2f74a31,host='devstack@QuobyteHD#QuobyteHD',id=8c93de5a-c233-4ed8-b731-08de8525ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:10Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc4273eb-226c-4401-997f-fa7510dfd28e),volume_type_id=fc4273eb-226c-4401-997f-fa7510dfd28e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18656681-c475-4124-a700-cbc5486369e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18656681-c475-4124-a700-cbc5486369e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d418846c-aa1e-400e-8ad8-6a2e8aac2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d418846c-aa1e-400e-8ad8-6a2e8aac2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c93de5a-c233-4ed8-b731-08de8525ac1b', 'volume_name': 'volume-8c93de5a-c233-4ed8-b731-08de8525ac1b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ababf82-ac36-475a-b838-eb4f8e062a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ababf82-ac36-475a-b838-eb4f8e062a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c11761-7ccf-4d41-b37d-089c14dff97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:09 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Volume 8c93de5a-c233-4ed8-b731-08de8525ac1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c93de5a-c233-4ed8-b731-08de8525ac1b', 'volume_size': 1}
Apr 29 08:36:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:10 devstack sudo[87579]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 1073741824" returned: 0 in 1.028s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:10 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77
Apr 29 08:36:10 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:11 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77" returned: 0 in 0.679s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.142s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e2e9538f-aa40-4e48-aead-7382f2f74a31,created_at=2026-04-29T06:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166220663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e2e9538f-aa40-4e48-aead-7382f2f74a31,host='devstack@QuobyteHD#QuobyteHD',id=8c93de5a-c233-4ed8-b731-08de8525ac1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:10Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc4273eb-226c-4401-997f-fa7510dfd28e),volume_type_id=fc4273eb-226c-4401-997f-fa7510dfd28e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Creating volume 8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:11 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ac9ca7-107f-4cd0-99db-4ac56b0f2d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdbf46c-92c5-4719-9e10-2aee66213b77', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:11 devstack sudo[87596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b 1073741824
Apr 29 08:36:11 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0b6813-936f-46e9-b3ec-49c637f5a798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Volume volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 (5fdbf46c-92c5-4719-9e10-2aee66213b77): created successfully
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0b6813-936f-46e9-b3ec-49c637f5a798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (22df6dce-3d4c-46b9-ad00-0530e415116c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:11 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-435da3a8-97d1-4163-baff-efa16582559f tempest-VolumesDeleteCascade-965036853 None] Created volume successfully.
Apr 29 08:36:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:12 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b 1073741824" returned: 0 in 1.051s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:12 devstack sudo[87608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:12 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:12 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 0.736s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.678s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=109,cinder:UPDATE=126,cinder:INSERT=31,cinder:DELETE=11 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c11761-7ccf-4d41-b37d-089c14dff97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c93de5a-c233-4ed8-b731-08de8525ac1b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b0b18d-ef4a-4231-96ef-236c8c14c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53574d6-5df5-417c-abbb-7fdaacba2ea2]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Volume volume-8c93de5a-c233-4ed8-b731-08de8525ac1b (8c93de5a-c233-4ed8-b731-08de8525ac1b): created successfully
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b0b18d-ef4a-4231-96ef-236c8c14c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (ab937685-e392-458f-8f0b-e3b31c6d79d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-773ce143-866c-44f5-927a-e1220065fa1e tempest-GroupSnapshotsTest-1510866578 None] Created volume successfully.
Apr 29 08:36:13 devstack sudo[87611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:13 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] GroupSnapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: creating.
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=85,cinder:INSERT=39,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Group snapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: creating. {{(pid=84102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:13 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 0.757s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:13 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:13 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:14 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 1 in 0.688s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.494s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.754s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Creating offline snapshot f72c84ae-3a8a-467d-b665-486b364ea9a9 of volume 5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[720aead2-4975-46a8-b882-572f02336ec3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336', 'name': 'volume-758c73e6-c88e-4449-9b55-38dbc58f5237', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d2df793-33d0-4486-ad2e-645209960cd8', 'enforce_multipath': True} {{(pid=84102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 08:36:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-9099e7f7-eafe-4aaf-aded-fa28ad4f1654 req-c484b8dc-4505-418e-9d79-fce3d3b43f3a tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] attachment_update completed successfully.
Apr 29 08:36:14 devstack sudo[87620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77
Apr 29 08:36:14 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:15 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77" returned: 0 in 0.830s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:15 devstack sudo[87625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 1G
Apr 29 08:36:15 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:16 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 1G" returned: 0 in 0.822s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:16 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:16 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Flow 'volume_create_manager' (5447002f-e66b-4efa-bbf2-3fe124a98a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59497857-cf8e-4b2b-8106-889007695760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59497857-cf8e-4b2b-8106-889007695760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1944011119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6430d3-88c0-4aa2-89e8-02facaa9a74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e6752202bf477d99c6f988823fc44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:16Z,use_quota=True,user_id='f61afb08f1004d548ed9281754af4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c11330b2-8cc3-4fe7-bd56-b44bed622ae2),volume_type_id=c11330b2-8cc3-4fe7-bd56-b44bed622ae2)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330fe7ec-2d15-4f4d-9b48-1638ea37820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330fe7ec-2d15-4f4d-9b48-1638ea37820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d518b822-7823-46b7-b99a-7e45b7a7436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d518b822-7823-46b7-b99a-7e45b7a7436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6430d3-88c0-4aa2-89e8-02facaa9a74a', 'volume_name': 'volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03d5b25-9f64-4e5e-945b-3427ccdba7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03d5b25-9f64-4e5e-945b-3427ccdba7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e314aa64-d81f-414b-9619-20f0aa828dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:16 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Volume 0c6430d3-88c0-4aa2-89e8-02facaa9a74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a', 'volume_size': 1}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:16 devstack sudo[87636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:16 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:16 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 0.721s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:16 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 is being set with open permissions: ugo+rw
Apr 29 08:36:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:16 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:16 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:17 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.630s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:17 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 0.625s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:17 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info
Apr 29 08:36:17 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:18 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info" returned: 0 in 0.617s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:18 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info is being set with open permissions: ugo+rw
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:18 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info
Apr 29 08:36:18 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:18 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.info" returned: 0 in 0.588s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.299s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.274s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Creating offline snapshot 54b41aa4-f737-4676-a42f-ab0488c26a0e of volume 8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:36:18 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-87f5914f-356e-4527-a4bb-ebcc3c53bf1c tempest-VolumesDeleteCascade-965036853 None] Create snapshot completed successfully
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a6b5d-779b-40e9-b4d1-4d79f448efe7]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:18 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:18 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:19 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 0.906s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:19 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e 1G
Apr 29 08:36:19 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:20 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e 1G" returned: 0 in 0.832s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c93de5a-c233-4ed8-b731-08de8525ac1b -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:20 devstack sudo[87700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c93de5a-c233-4ed8-b731-08de8525ac1b -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:20 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:21 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c93de5a-c233-4ed8-b731-08de8525ac1b -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 0.699s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:21 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:21 devstack sudo[87706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:21 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:22 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 0.918s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:22 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info
Apr 29 08:36:22 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:22 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info" returned: 0 in 0.637s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:22 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:22 devstack sudo[87712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info
Apr 29 08:36:22 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:23 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.info" returned: 0 in 0.682s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.973s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1944011119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6430d3-88c0-4aa2-89e8-02facaa9a74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e6752202bf477d99c6f988823fc44a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:16Z,use_quota=True,user_id='f61afb08f1004d548ed9281754af4b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c11330b2-8cc3-4fe7-bd56-b44bed622ae2),volume_type_id=c11330b2-8cc3-4fe7-bd56-b44bed622ae2)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Creating volume 0c6430d3-88c0-4aa2-89e8-02facaa9a74a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:23 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:23 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a 1073741824
Apr 29 08:36:23 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ca694507-1dbe-4b89-95cb-ecc01eafde74 tempest-GroupSnapshotsTest-1510866578 None] group_snapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: created successfully
Apr 29 08:36:24 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a 1073741824" returned: 0 in 1.062s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:24 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a
Apr 29 08:36:24 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:25 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" returned: 0 in 0.726s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.101s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Creating offline snapshot 762a21e0-a3e0-4e1d-a700-958b6aadb0aa of volume 5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e314aa64-d81f-414b-9619-20f0aa828dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787a8d3-4fed-4371-8116-fc2c0f5736c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab1605a-b71c-462b-8de2-a024e4c82e1f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Volume volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a (0c6430d3-88c0-4aa2-89e8-02facaa9a74a): created successfully
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0787a8d3-4fed-4371-8116-fc2c0f5736c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Flow 'volume_create_manager' (5447002f-e66b-4efa-bbf2-3fe124a98a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:25 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-166cc1d3-4b90-4881-9d0a-a398ec0e3c66 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Created volume successfully.
Apr 29 08:36:25 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:25 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:26 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 0.998s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdbf46c-92c5-4719-9e10-2aee66213b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:26 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa 1G
Apr 29 08:36:26 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:26 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:26 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:27 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d49e6fc1-ffd5-46b1-b7f5-b6eaa45d824c tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Retype volume completed successfully.
Apr 29 08:36:27 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa 1G" returned: 0 in 1.098s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:27 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa
Apr 29 08:36:27 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "cinder-0c6430d3-88c0-4aa2-89e8-02facaa9a74a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "cinder-0c6430d3-88c0-4aa2-89e8-02facaa9a74a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "cinder-quobyte-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "cinder-quobyte-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508bbcc-f285-4385-bbd6-43a39fc3e9e3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:28 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a
Apr 29 08:36:28 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:28 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa" returned: 0 in 1.012s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:28 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa is being set with open permissions: ugo+rw
Apr 29 08:36:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:28 devstack sudo[87775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa
Apr 29 08:36:28 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:29 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" returned: 0 in 0.891s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:29 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa" returned: 0 in 0.684s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:29 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a
Apr 29 08:36:29 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.055s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e-f69031e0-f626-466a-97cd-20c68a877440" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e-f69031e0-f626-466a-97cd-20c68a877440" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Creating volume f69031e0-f626-466a-97cd-20c68a877440 from snapshot 54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:29 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-90c106cb-31cb-48dd-926c-37f3b3282837 tempest-VolumesDeleteCascade-965036853 None] Create snapshot completed successfully
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] snapshot: 54b41aa4-f737-4676-a42f-ab0488c26a0e, volume: f69031e0-f626-466a-97cd-20c68a877440,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815606c-e688-4c87-a4df-4555631fa777]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:29 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:29 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-5fdbf46c-92c5-4719-9e10-2aee66213b77-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-5fdbf46c-92c5-4719-9e10-2aee66213b77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Performing cascade delete. {{(pid=84102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 08:36:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-762a21e0-a3e0-4e1d-a700-958b6aadb0aa-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-762a21e0-a3e0-4e1d-a700-958b6aadb0aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-762a21e0-a3e0-4e1d-a700-958b6aadb0aa" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-762a21e0-a3e0-4e1d-a700-958b6aadb0aa" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Deleting offline snapshot 762a21e0-a3e0-4e1d-a700-958b6aadb0aa of volume 5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] snapshot_file for this snap is: volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[525d03b6-7206-4162-b0fe-834796ce45b1]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:30 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" returned: 0 in 0.944s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "cinder-quobyte-0c6430d3-88c0-4aa2-89e8-02facaa9a74a" released by "delete_volume" :: held 1.901s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:30 devstack cinder-volume[84102]: WARNING cinder.quota [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:30 devstack cinder-volume[84102]: WARNING cinder.quota [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Created reservations ['e7fbc1a5-d3aa-4de3-8114-c9c4ad46fbbe', '2692d156-024a-4a69-b472-daf0387a2122', '46f2278e-8162-4c4d-a3e8-088abcaaccb8', '160712c8-41aa-417f-8c4a-fae4bac8d3d6'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:30 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa
Apr 29 08:36:30 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:30 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 1.030s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c93de5a-c233-4ed8-b731-08de8525ac1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:36:30 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:30 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d4f6c5-72c5-49ed-a3be-dbee5ad8f0cc]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:30 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:30 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:31 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa" returned: 0 in 1.076s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdbf46c-92c5-4719-9e10-2aee66213b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a8d0e-0030-493d-ab6f-8194f14913c9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:31 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.793s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Deleted volume successfully.
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3f80c6b7-1dcd-48c8-97c3-f55f6a966525 tempest-VolumeRetypeWithoutMigrationTest-1018828691 None] Lock "cinder-0c6430d3-88c0-4aa2-89e8-02facaa9a74a-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:31 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 0.814s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:36:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:31 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:31 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:31 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440
Apr 29 08:36:31 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:32 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 0.861s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdbf46c-92c5-4719-9e10-2aee66213b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:32 devstack sudo[87838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa
Apr 29 08:36:32 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:34 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa" returned: 0 in 2.177s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:34 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa
Apr 29 08:36:34 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:35 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.762a21e0-a3e0-4e1d-a700-958b6aadb0aa" returned: 0 in 1.120s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-762a21e0-a3e0-4e1d-a700-958b6aadb0aa" released by "_delete_snapshot" :: held 5.408s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" released by "delete_snapshot" :: held 5.497s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:35 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Created reservations ['87183db4-44b2-44be-a436-5f55836b6673', '67f1bc59-5712-4e5d-bf70-bf2bba07f37e', '455341f3-5a37-45f0-82f1-bab00e062607', '1a495da9-16df-4807-b6c0-e574144f20e0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Delete snapshot completed successfully.
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-762a21e0-a3e0-4e1d-a700-958b6aadb0aa-delete_snapshot" released by "delete_snapshot" :: held 6.165s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-f72c84ae-3a8a-467d-b665-486b364ea9a9-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-f72c84ae-3a8a-467d-b665-486b364ea9a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" acquired by "delete_snapshot" :: waited 0.060s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-f72c84ae-3a8a-467d-b665-486b364ea9a9" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f72c84ae-3a8a-467d-b665-486b364ea9a9" acquired by "_delete_snapshot" :: waited 0.078s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Deleting offline snapshot f72c84ae-3a8a-467d-b665-486b364ea9a9 of volume 5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] snapshot_file for this snap is: volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce404b4-e3ba-437c-bc54-8bf08bb58742]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:37 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:37 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:39 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 2.649s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdbf46c-92c5-4719-9e10-2aee66213b77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:39 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440" returned: 0 in 7.925s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed6a51-aa44-4ccd-9b39-7e1d477a1e31]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b24427-8d74-40a6-b7f4-fe5c4494d4ed]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:39 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77
Apr 29 08:36:39 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:39 devstack sudo[87928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:39 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:40 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77" returned: 0 in 1.436s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:40 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:40 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:41 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 1.872s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:41 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:36:41 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Converted 1024.00 MB image at 129.19 MB/s
Apr 29 08:36:41 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:36:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:41 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440
Apr 29 08:36:41 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:42 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 1.340s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:42 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9
Apr 29 08:36:42 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:42 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440" returned: 0 in 0.957s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" released by "_copy_volume_from_snapshot" :: held 12.759s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e-f69031e0-f626-466a-97cd-20c68a877440" released by "_create_volume_from_snapshot" :: held 12.809s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.843s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-254c33c2-7f2a-42b5-9972-0e7472995889 tempest-GroupSnapshotsTest-1510866578 None] Create group from source-snapshot-cf34f926-9541-4f84-a8fa-26f96d5d4a44 completed successfully.
Apr 29 08:36:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab45ccb2-c90f-4bb0-aac0-c368936752db]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:43 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440
Apr 29 08:36:43 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:43 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77.f72c84ae-3a8a-467d-b665-486b364ea9a9" returned: 0 in 1.163s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f72c84ae-3a8a-467d-b665-486b364ea9a9" released by "_delete_snapshot" :: held 6.857s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" released by "delete_snapshot" :: held 6.960s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Created reservations ['5eca3d1d-f746-40b5-ae74-a687bc33a188', 'c56b12f2-c4b6-4ecd-b36b-32553976a945', '79b34c68-cd07-4833-a590-6577efea6c6f', 'a8db5011-cf69-4cde-ab75-79a9dc6bc081'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:43 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Delete snapshot completed successfully.
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-f72c84ae-3a8a-467d-b665-486b364ea9a9-delete_snapshot" released by "delete_snapshot" :: held 7.277s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Snapshots deleted, issuing volume delete {{(pid=84102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c409b74-3495-417e-b9b3-050f874b8203]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:43 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77
Apr 29 08:36:43 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:44 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440" returned: 0 in 1.509s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:44 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440
Apr 29 08:36:44 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:44 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77" returned: 0 in 1.295s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:45 devstack sudo[88008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77
Apr 29 08:36:45 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Flow 'volume_create_manager' (2fd1cc47-db6d-45eb-86d5-816622b0e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80fe02f-3e2c-43c7-9473-01e1c81ec46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d80fe02f-3e2c-43c7-9473-01e1c81ec46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1795380974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbc6d89-f64e-45e3-ac13-25dced08c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb6cdfd13b4cfe8be591fd1870e21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:45Z,use_quota=True,user_id='850d5b7ea8464e138e535d609cfff218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4b430d-7c5b-46f7-b3e2-bef631cf550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4b430d-7c5b-46f7-b3e2-bef631cf550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656020d1-e912-4ed3-9acd-b0148feb6c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656020d1-e912-4ed3-9acd-b0148feb6c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdbc6d89-f64e-45e3-ac13-25dced08c688', 'volume_name': 'volume-fdbc6d89-f64e-45e3-ac13-25dced08c688', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0319b699-c107-421b-ac27-03df7779e979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0319b699-c107-421b-ac27-03df7779e979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cf563c-aed3-4f6a-a6cf-c4f2e2d73a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:45 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Volume fdbc6d89-f64e-45e3-ac13-25dced08c688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdbc6d89-f64e-45e3-ac13-25dced08c688', 'volume_size': 1}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1795380974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbc6d89-f64e-45e3-ac13-25dced08c688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb6cdfd13b4cfe8be591fd1870e21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:45Z,use_quota=True,user_id='850d5b7ea8464e138e535d609cfff218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Creating volume fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:45 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:45 devstack sudo[88038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 1073741824
Apr 29 08:36:45 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:45 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5fdbf46c-92c5-4719-9e10-2aee66213b77" returned: 0 in 0.894s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:45 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f69031e0-f626-466a-97cd-20c68a877440" returned: 0 in 1.303s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5fdbf46c-92c5-4719-9e10-2aee66213b77" released by "delete_volume" :: held 2.322s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-f69031e0-f626-466a-97cd-20c68a877440" released by "delete_volume" :: held 2.889s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:45 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Created reservations ['ab0ddd69-67cd-4b0f-8d2a-e7441633575b', '47b95dbb-7032-43f0-b4b1-fc9571ee076e', '7a48b999-f518-40aa-ae6b-0364d3c4a06e', '2cc496a0-d809-4e5e-96d2-18c6fb021081'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['2f31ae61-3bff-43d9-8de2-7d737b3ed534'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:46 devstack cinder-volume[84102]: WARNING cinder.quota [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1441119673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1441119673, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:46 devstack cinder-volume[84102]: WARNING cinder.quota [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1441119673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1441119673, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:46 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['ea2f1405-23c5-451c-bb63-8398f5851a90', '12ab48ad-b0ac-49bb-9cfc-96bdfc13d5e8', 'f8416fff-d762-4a68-a3d7-54dfdda42439', 'b41f3ea9-bfeb-4e58-ad7a-bb9462b56d8a'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:46 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:46 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] group_snapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: deleting
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] group_snapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: deleting {{(pid=84102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:36:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" acquired by "delete_snapshot" :: waited 0.081s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Deleting offline snapshot 54b41aa4-f737-4676-a42f-ab0488c26a0e of volume 8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] snapshot_file for this snap is: volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6200ac-edf3-4f6e-bcca-167957c332b8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:47 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 1073741824" returned: 0 in 1.911s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:47 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.184s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Deleted volume successfully.
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:47 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688
Apr 29 08:36:47 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-bae07d29-0675-4385-92e0-339e277e9e8a tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-5fdbf46c-92c5-4719-9e10-2aee66213b77-delete_volume" released by "delete_volume" :: held 17.569s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:47 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:47 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:47 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.295s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-97c8b997-2ce7-4a3c-b867-7db7c2b8d19b tempest-GroupSnapshotsTest-1510866578 None] Delete group completed successfully.
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (6288fc00-830a-4cc1-9745-758dd136464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccf2a19-814c-42d7-a736-f45da325d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccf2a19-814c-42d7-a736-f45da325d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-687114092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7a9182-a263-475a-85f3-eb4cc7923509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdc703851384c7d877616c3c7856e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:48Z,use_quota=True,user_id='834be5b9b872416fa058c4085a88be4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707a8181-d4ca-4a16-ad23-f9a3c2840ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707a8181-d4ca-4a16-ad23-f9a3c2840ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ddaf01-4fad-4a68-a39e-67e96a7cfb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ddaf01-4fad-4a68-a39e-67e96a7cfb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7a9182-a263-475a-85f3-eb4cc7923509', 'volume_name': 'volume-ef7a9182-a263-475a-85f3-eb4cc7923509', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e01c7-7f5a-44ea-a072-d9504629507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50e01c7-7f5a-44ea-a072-d9504629507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9618037b-37fb-4478-9185-7062ceba7a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Volume ef7a9182-a263-475a-85f3-eb4cc7923509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7a9182-a263-475a-85f3-eb4cc7923509', 'volume_size': 1}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:48 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688" returned: 0 in 1.059s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] <== create_volume: return (3106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.118s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-687114092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7a9182-a263-475a-85f3-eb4cc7923509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdc703851384c7d877616c3c7856e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:48Z,use_quota=True,user_id='834be5b9b872416fa058c4085a88be4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Creating volume ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:36:48 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:48 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 1073741824
Apr 29 08:36:48 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cf563c-aed3-4f6a-a6cf-c4f2e2d73a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbc6d89-f64e-45e3-ac13-25dced08c688', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e92eb5-43ef-4c50-9495-e7cf38c26816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:48 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Volume volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 (fdbc6d89-f64e-45e3-ac13-25dced08c688): created successfully
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e92eb5-43ef-4c50-9495-e7cf38c26816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Flow 'volume_create_manager' (2fd1cc47-db6d-45eb-86d5-816622b0e221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-44c8ca4b-a7ae-404c-b33e-ac0713cc30a5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Created volume successfully.
Apr 29 08:36:48 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 1.547s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c93de5a-c233-4ed8-b731-08de8525ac1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[11750d31-4e05-4fdc-a534-7299a4dad357]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:49 devstack sudo[88065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:49 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:49 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 1073741824" returned: 0 in 1.314s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:49 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:36:49 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:50 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 1.172s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:50 devstack sudo[88106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:50 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:50 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.702s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9618037b-37fb-4478-9185-7062ceba7a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7a9182-a263-475a-85f3-eb4cc7923509', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b8f12-e823-468a-9cd3-6355c2d8e447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Creating offline snapshot 37f61928-3762-4649-8160-c861011976d4 of volume fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:36:50 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Volume volume-ef7a9182-a263-475a-85f3-eb4cc7923509 (ef7a9182-a263-475a-85f3-eb4cc7923509): created successfully
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2b8f12-e823-468a-9cd3-6355c2d8e447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (6288fc00-830a-4cc1-9745-758dd136464c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3da5c3e-c8d6-42fa-ad59-a1ea27747dcd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:50 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a6dce396-5922-4565-b238-6192ed70c223 tempest-VolumesDeleteCascade-965036853 None] Created volume successfully.
Apr 29 08:36:50 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 0.790s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:50 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688
Apr 29 08:36:50 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:50 devstack sudo[88117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e
Apr 29 08:36:50 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:51 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b.54b41aa4-f737-4676-a42f-ab0488c26a0e" returned: 0 in 0.833s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-54b41aa4-f737-4676-a42f-ab0488c26a0e" released by "_delete_snapshot" :: held 4.562s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" released by "delete_snapshot" :: held 4.623s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:51 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688" returned: 0 in 1.045s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:51 devstack sudo[88126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 1G
Apr 29 08:36:51 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:51 devstack cinder-volume[84102]: WARNING cinder.quota [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1441119673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1441119673, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:36:51 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['b8cfcb1e-1a9b-43a4-a5d1-f0393cb44f21', 'ceaaee89-cecc-4464-9feb-9433b1e63fba', '3ef13f29-60a0-41b7-a1dc-014f7a779a70', '0d8d81ef-b486-4e58-8deb-37f1554ab075'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3eb455e7-ac2b-426a-8efd-c3ba00361c6d tempest-GroupSnapshotsTest-1510866578 None] group_snapshot cf34f926-9541-4f84-a8fa-26f96d5d4a44: deleted successfully
Apr 29 08:36:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-148f9617-994b-43d7-850f-54b7d831b262 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Terminate volume connection completed successfully.
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-148f9617-994b-43d7-850f-54b7d831b262 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Deleting attachment 9d2df793-33d0-4486-ad2e-645209960cd8. {{(pid=84102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:36:52 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 1G" returned: 0 in 0.795s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:52 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4
Apr 29 08:36:52 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b2e2b4-cbae-4e9a-aa7c-a86b91c3376a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:52 devstack sudo[88133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:52 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "cinder-758c73e6-c88e-4449-9b55-38dbc58f5237-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-758c73e6-c88e-4449-9b55-38dbc58f5237-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "cinder-quobyte-758c73e6-c88e-4449-9b55-38dbc58f5237" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-quobyte-758c73e6-c88e-4449-9b55-38dbc58f5237" acquired by "delete_volume" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:53 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4" returned: 0 in 0.779s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:53 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 is being set with open permissions: ugo+rw
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdabe2-5eb0-404d-9bcf-5114f9236917]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4
Apr 29 08:36:53 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:53 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:53 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 0.943s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:53 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b
Apr 29 08:36:53 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4" returned: 0 in 0.810s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:54 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info
Apr 29 08:36:54 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 0.912s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:54 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8c93de5a-c233-4ed8-b731-08de8525ac1b" returned: 0 in 0.767s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack sudo[88189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:54 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-8c93de5a-c233-4ed8-b731-08de8525ac1b" released by "delete_volume" :: held 1.803s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['6f3ac7c8-4cd1-4856-ac0e-2972edf11605'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:54 devstack cinder-volume[84102]: WARNING cinder.db.sqlalchemy.api [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1441119673']
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['abcd3745-75b7-498d-8a2f-5c4e830890fa', 'd23adeab-e5db-457d-87c3-684312430ae9', 'f700dd51-537d-4f45-bbd4-3e30653a3969', 'ee5f00b6-beaa-4959-adb2-1f247bd94ddb'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:54 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:54 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:54 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info" returned: 0 in 0.664s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:54 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info is being set with open permissions: ugo+rw
Apr 29 08:36:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:54 devstack sudo[88194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info
Apr 29 08:36:54 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:55 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 1 in 0.885s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:55 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237
Apr 29 08:36:55 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a3028e78-09d3-40c8-9ba7-7e958d6d0576 tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-1698271424: creating
Apr 29 08:36:55 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.855s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a3028e78-09d3-40c8-9ba7-7e958d6d0576 tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-1698271424: created successfully
Apr 29 08:36:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-60c96cc9-059c-426c-a402-50169af712e3 tempest-GroupSnapshotsTest-1510866578 None] Delete group completed successfully.
Apr 29 08:36:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a3028e78-09d3-40c8-9ba7-7e958d6d0576 tempest-GroupSnapshotsTest-1510866578 None] Create group completed successfully.
Apr 29 08:36:55 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.info" returned: 0 in 0.846s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.099s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.088s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Creating offline snapshot 5eafd89a-81df-4929-ab09-abfea08c5d70 of volume ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dec98c-0df6-4555-a347-7baba552e8eb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a1dc1b49-ae99-426c-bbfe-81758755db3a tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Create snapshot completed successfully
Apr 29 08:36:55 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:36:55 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:55 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-758c73e6-c88e-4449-9b55-38dbc58f5237" returned: 0 in 0.758s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-quobyte-758c73e6-c88e-4449-9b55-38dbc58f5237" released by "delete_volume" :: held 2.652s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:55 devstack cinder-volume[84102]: DEBUG cinder.quota [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Created reservations ['9bdad57a-55f1-4dd7-8795-2b3ef4ed69f9', '292901ac-08c6-4db8-b319-f55e26928531', 'abe7363c-949d-4ab1-9dba-5e78404a1313', 'e1f49576-7e16-4586-b90c-75505edeb667'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:56 devstack sudo[88207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:36:56 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:56 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.941s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:56 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.698s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.manager [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:36:56 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 1G
Apr 29 08:36:56 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Deleted volume successfully.
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-e7e63229-b534-4ff0-810b-638aa8f22575 req-f6b36d90-a32a-4e01-b8dc-065b6603d9b5 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-758c73e6-c88e-4449-9b55-38dbc58f5237-delete_volume" released by "delete_volume" :: held 3.617s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "cinder-37f61928-3762-4649-8160-c861011976d4-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-37f61928-3762-4649-8160-c861011976d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "cinder-quobyte-37f61928-3762-4649-8160-c861011976d4" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-37f61928-3762-4649-8160-c861011976d4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Deleting offline snapshot 37f61928-3762-4649-8160-c861011976d4 of volume fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] snapshot_file for this snap is: volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1a8fd-0272-40fa-9347-978c5b06f88a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:57 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4
Apr 29 08:36:57 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (65c3c880-5e16-4cd9-9a07-b71867cfc241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae262083-9356-4636-a555-8306e4ab26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae262083-9356-4636-a555-8306e4ab26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1491391732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,host='devstack@QuobyteHD#QuobyteHD',id=c3f99217-5cd9-4d0e-9062-f88821c0b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:57Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6),volume_type_id=75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e8be6e-c09a-427d-a25a-e556331b506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e8be6e-c09a-427d-a25a-e556331b506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab8acce-fd3f-405e-8104-bfc7e8fa0c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab8acce-fd3f-405e-8104-bfc7e8fa0c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f99217-5cd9-4d0e-9062-f88821c0b519', 'volume_name': 'volume-c3f99217-5cd9-4d0e-9062-f88821c0b519', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2f552e-8373-446e-b46a-b27aa8e4db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2f552e-8373-446e-b46a-b27aa8e4db51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7b5533-6869-4180-a660-a1d38738c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:36:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Volume c3f99217-5cd9-4d0e-9062-f88821c0b519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f99217-5cd9-4d0e-9062-f88821c0b519', 'volume_size': 1}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:36:57 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 1G" returned: 0 in 0.966s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a9182-a263-475a-85f3-eb4cc7923509 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:57 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a9182-a263-475a-85f3-eb4cc7923509 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:36:57 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:58 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4" returned: 0 in 0.948s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdbc6d89-f64e-45e3-ac13-25dced08c688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7da4de-89b3-499a-ab74-dd3e176843a3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:58 devstack sudo[88233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688
Apr 29 08:36:58 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:58 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef7a9182-a263-475a-85f3-eb4cc7923509 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 0.926s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:58 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 is being set with open permissions: ugo+rw
Apr 29 08:36:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:58 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:36:58 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:59 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688" returned: 0 in 1.053s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:59 devstack sudo[88269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4
Apr 29 08:36:59 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:59 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 0.785s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:59 devstack sudo[88272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info
Apr 29 08:36:59 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:36:59 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4" returned: 0 in 0.763s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:36:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:36:59 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4
Apr 29 08:36:59 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:00 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info" returned: 0 in 0.710s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:00 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info is being set with open permissions: ugo+rw
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:00 devstack sudo[88282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info
Apr 29 08:37:00 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:00 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688.37f61928-3762-4649-8160-c861011976d4" returned: 0 in 0.683s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-37f61928-3762-4649-8160-c861011976d4" released by "_delete_snapshot" :: held 3.606s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" released by "delete_snapshot" :: held 3.642s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Created reservations ['c0ca374f-b887-431a-a48d-9d4dafcfb5f4', 'dd560e45-2b5f-4d8d-825d-c0443f0e0671', '56873787-04f9-46b6-9663-f97ddffe9b37', 'a9b1f214-f7dd-4865-9f9b-74a3140e5305'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Delete snapshot completed successfully.
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe7e477d-c59d-4580-b486-692f680212f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-37f61928-3762-4649-8160-c861011976d4-delete_snapshot" released by "delete_snapshot" :: held 3.827s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:00 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.info" returned: 0 in 0.685s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.125s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.377s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,created_at=2026-04-29T06:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1491391732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,host='devstack@QuobyteHD#QuobyteHD',id=c3f99217-5cd9-4d0e-9062-f88821c0b519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:36:57Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6),volume_type_id=75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Creating volume c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:00 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:00 devstack sudo[88286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 1073741824
Apr 29 08:37:00 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7b48a9e9-4a7a-472b-bd24-858869dbfa2e tempest-VolumesDeleteCascade-965036853 None] Create snapshot completed successfully
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "cinder-fdbc6d89-f64e-45e3-ac13-25dced08c688-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-fdbc6d89-f64e-45e3-ac13-25dced08c688-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70fe0df-363a-4280-833c-208d7759e695]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:01 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688
Apr 29 08:37:01 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (0ce565f9-dcc9-4408-83a6-cf8645ec9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6392dd8-71cf-44c8-a8fc-57da671ac8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6392dd8-71cf-44c8-a8fc-57da671ac8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1831005712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68d6faf-3a01-46d8-8e98-8a9e69637430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdc703851384c7d877616c3c7856e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5eafd89a-81df-4929-ab09-abfea08c5d70,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:02Z,use_quota=True,user_id='834be5b9b872416fa058c4085a88be4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd14139-8fa2-4369-99ce-d4f0daf4b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd14139-8fa2-4369-99ce-d4f0daf4b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9820ac57-29ba-4fec-b989-ef61ddb24bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9820ac57-29ba-4fec-b989-ef61ddb24bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f68d6faf-3a01-46d8-8e98-8a9e69637430', 'volume_name': 'volume-f68d6faf-3a01-46d8-8e98-8a9e69637430', 'volume_size': 1, 'snapshot_id': '5eafd89a-81df-4929-ab09-abfea08c5d70'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae4f4ec-8d7e-42c6-98df-895edf21229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fae4f4ec-8d7e-42c6-98df-895edf21229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d6c6eb-309b-4ff8-b985-7307e926995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:01 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Volume f68d6faf-3a01-46d8-8e98-8a9e69637430: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f68d6faf-3a01-46d8-8e98-8a9e69637430', 'volume_size': 1, 'snapshot_id': '5eafd89a-81df-4929-ab09-abfea08c5d70'}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:01 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 1073741824" returned: 0 in 1.093s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:02 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519
Apr 29 08:37:02 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:02 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688" returned: 0 in 0.893s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:02 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688
Apr 29 08:37:02 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:02 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519" returned: 0 in 0.613s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.699s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70-f68d6faf-3a01-46d8-8e98-8a9e69637430" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7b5533-6869-4180-a660-a1d38738c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f99217-5cd9-4d0e-9062-f88821c0b519', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be03ff7b-8e60-4753-83e5-5c1bbd418c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70-f68d6faf-3a01-46d8-8e98-8a9e69637430" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Creating volume f68d6faf-3a01-46d8-8e98-8a9e69637430 from snapshot 5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:02 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Volume volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 (c3f99217-5cd9-4d0e-9062-f88821c0b519): created successfully
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be03ff7b-8e60-4753-83e5-5c1bbd418c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (65c3c880-5e16-4cd9-9a07-b71867cfc241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] snapshot: 5eafd89a-81df-4929-ab09-abfea08c5d70, volume: f68d6faf-3a01-46d8-8e98-8a9e69637430,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:37:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-565d2641-82e3-4546-b904-5bfac6c96a60 tempest-GroupSnapshotsTest-1510866578 None] Created volume successfully.
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95917e33-4929-4393-9327-38f6cb9a25e9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:02 devstack sudo[88302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:37:02 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:03 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fdbc6d89-f64e-45e3-ac13-25dced08c688" returned: 0 in 0.708s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-quobyte-fdbc6d89-f64e-45e3-ac13-25dced08c688" released by "delete_volume" :: held 1.700s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Created reservations ['72c1ce34-ef0a-4a64-89f3-ca885b0caa88', 'f2af73dd-2a8e-4593-b764-5dfec1634881', 'bf9c8f1b-d295-4ba3-87fd-aa57ab848d04', 'de3c317b-4ffb-4674-8d9a-0fe9d2b48ff6'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:03 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:03 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (8d3f7ca8-d294-44e3-b967-01b2f63bf896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e57a6d-32a2-4ed5-bf51-5539ceb8306a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e57a6d-32a2-4ed5-bf51-5539ceb8306a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440371690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,host='devstack@QuobyteHD#QuobyteHD',id=40745f22-7f2c-47f0-af03-2e870c362463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:04Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6),volume_type_id=75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c091e7b-3af5-4abf-a6fa-b49d09c5caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c091e7b-3af5-4abf-a6fa-b49d09c5caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ad65e-4536-4930-b5f5-c3bbcde036ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826ad65e-4536-4930-b5f5-c3bbcde036ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40745f22-7f2c-47f0-af03-2e870c362463', 'volume_name': 'volume-40745f22-7f2c-47f0-af03-2e870c362463', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:03 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cbf44d-11a5-4fdb-836f-493d8f4995e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cbf44d-11a5-4fdb-836f-493d8f4995e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25895b8e-1e85-48ac-bb27-6d8fb852e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:03 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Volume 40745f22-7f2c-47f0-af03-2e870c362463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40745f22-7f2c-47f0-af03-2e870c362463', 'volume_size': 1}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 0.998s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7a9182-a263-475a-85f3-eb4cc7923509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2cd9ea-4a41-4acc-ac94-5e28948f4a59]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:03 devstack sudo[88311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:37:03 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:04 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.866s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Deleted volume successfully.
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2421bc22-50ba-4a80-a4b3-21ccf2975ecb tempest-VolumeSnapshotQuotasNegativeTestJSON-1750686546 None] Lock "cinder-fdbc6d89-f64e-45e3-ac13-25dced08c688-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:04 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.758s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:37:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:04 devstack sudo[88318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430
Apr 29 08:37:04 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-3a3dc4e8-4b97-4265-b204-c5f58df4b000 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Terminate volume connection completed successfully.
Apr 29 08:37:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-3a3dc4e8-4b97-4265-b204-c5f58df4b000 tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Deleting attachment 6f25012a-ae34-41a8-bc73-06217fe06de0. {{(pid=84102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 08:37:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "cinder-f501056b-cb20-412d-95df-9faa3745d687-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-f501056b-cb20-412d-95df-9faa3745d687-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "cinder-quobyte-f501056b-cb20-412d-95df-9faa3745d687" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-quobyte-f501056b-cb20-412d-95df-9faa3745d687" acquired by "delete_volume" :: waited 0.046s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:10 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a21be87-c8c7-43f5-a044-0c3305820816]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:10 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687
Apr 29 08:37:10 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:11 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430" returned: 0 in 6.677s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[945a069b-0ffa-49bb-8f5b-d71dc36f8ea7]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:11 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:37:11 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:11 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687" returned: 0 in 1.347s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:11 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687
Apr 29 08:37:11 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:12 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f501056b-cb20-412d-95df-9faa3745d687" returned: 0 in 0.730s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-quobyte-f501056b-cb20-412d-95df-9faa3745d687" released by "delete_volume" :: held 2.166s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:12 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.992s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:37:12 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Converted 1024.00 MB image at 153.30 MB/s
Apr 29 08:37:12 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 is being set with open permissions: ugo+rw
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:12 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430
Apr 29 08:37:12 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG cinder.quota [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Created reservations ['14d46931-0a7a-4841-a86d-de27f8a6d718', 'c459eb30-29df-4f52-ac9f-0835cb00be2f', 'ba423f61-4d52-4a90-a978-d516332a6f81', 'df8ebf53-28ed-4bb6-bcaf-918a0d99903c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:12 devstack sudo[88388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:12 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:12 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430" returned: 0 in 0.701s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" released by "_copy_volume_from_snapshot" :: held 10.293s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70-f68d6faf-3a01-46d8-8e98-8a9e69637430" released by "_create_volume_from_snapshot" :: held 10.350s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.402s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.212s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,created_at=2026-04-29T06:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440371690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2cc6cf5a-89f8-4033-9cc4-1dae049a6430,host='devstack@QuobyteHD#QuobyteHD',id=40745f22-7f2c-47f0-af03-2e870c362463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:04Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6),volume_type_id=75fd03ae-12dc-478c-b4a7-f6bf6a9c7fd6)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Creating volume 40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:13 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:13 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 1073741824
Apr 29 08:37:13 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d6c6eb-309b-4ff8-b985-7307e926995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68d6faf-3a01-46d8-8e98-8a9e69637430', 'volume_size': 1, 'snapshot_id': '5eafd89a-81df-4929-ab09-abfea08c5d70'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d19c05-3b8f-4ee8-b03a-9ab3ae1feb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:DELETE=5,cinder:SELECT=117,cinder:UPDATE=116,cinder:INSERT=23 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:37:13 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Volume volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 (f68d6faf-3a01-46d8-8e98-8a9e69637430): created successfully
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d19c05-3b8f-4ee8-b03a-9ab3ae1feb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Flow 'volume_create_manager' (0ce565f9-dcc9-4408-83a6-cf8645ec9307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.717s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.manager [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Deleted volume successfully.
Apr 29 08:37:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3e66b09d-e745-4110-90d1-31017935892b tempest-VolumesDeleteCascade-965036853 None] Created volume successfully.
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [req-d3e86d63-ec85-4b61-a1a5-c4d48c7f1403 req-cea321bb-c208-4315-94f0-5151b6c599ee tempest-ServerBootFromVolumeStableRescueTest-1958782941 None] Lock "cinder-f501056b-cb20-412d-95df-9faa3745d687-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-ef7a9182-a263-475a-85f3-eb4cc7923509-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-ef7a9182-a263-475a-85f3-eb4cc7923509-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=114,cinder:UPDATE=112,cinder:INSERT=31,cinder:DELETE=10 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Performing cascade delete. {{(pid=84102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-5eafd89a-81df-4929-ab09-abfea08c5d70-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-5eafd89a-81df-4929-ab09-abfea08c5d70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Deleting offline snapshot 5eafd89a-81df-4929-ab09-abfea08c5d70 of volume ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] snapshot_file for this snap is: volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5953a5-158c-4b94-a015-3f5989be85bb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:14 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:37:14 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:14 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 1073741824" returned: 0 in 1.266s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:14 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463
Apr 29 08:37:14 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:14 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 0.868s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef7a9182-a263-475a-85f3-eb4cc7923509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a003d-3ad7-477a-82af-0820c7af756b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:14 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:37:14 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:15 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25895b8e-1e85-48ac-bb27-6d8fb852e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40745f22-7f2c-47f0-af03-2e870c362463', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b497cbc-6df3-4258-bb15-e6218d98e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Volume volume-40745f22-7f2c-47f0-af03-2e870c362463 (40745f22-7f2c-47f0-af03-2e870c362463): created successfully
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b497cbc-6df3-4258-bb15-e6218d98e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (8d3f7ca8-d294-44e3-b967-01b2f63bf896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6de1f596-6da1-485a-8787-d944763fad9f tempest-GroupSnapshotsTest-1510866578 None] Created volume successfully.
Apr 29 08:37:15 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 1.060s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:15 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:37:15 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:16 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0ade57a3-5ab5-4873-88c9-6e611968f05d tempest-GroupSnapshotsTest-1510866578 None] Update group completed successfully.
Apr 29 08:37:16 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 0.833s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:16 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70
Apr 29 08:37:16 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:16 devstack sudo[88464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:16 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:17 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-568ff2ec-a55e-4001-9ffd-5c5a9e015f44 tempest-GroupSnapshotsTest-1510866578 None] Update group completed successfully.
Apr 29 08:37:17 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.920s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:17 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509.5eafd89a-81df-4929-ab09-abfea08c5d70" returned: 0 in 1.020s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-5eafd89a-81df-4929-ab09-abfea08c5d70" released by "_delete_snapshot" :: held 3.923s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" released by "delete_snapshot" :: held 3.957s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Created reservations ['f9c66212-d7aa-4c4c-8b91-04a20cb072c2', '6001d16e-6ea3-4036-984c-f68dc2a990a9', '66dc1fd2-6ed5-427f-a0f7-96f9d8b81620', '3f30b10f-dad7-4b4b-bf7b-85813162e253'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:17 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Delete snapshot completed successfully.
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-5eafd89a-81df-4929-ab09-abfea08c5d70-delete_snapshot" released by "delete_snapshot" :: held 4.128s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Snapshots deleted, issuing volume delete {{(pid=84102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" acquired by "delete_volume" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db5f06e-8dfa-4c21-81ec-886d9f43d058]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:18 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:37:18 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:18 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-74065fd2-8495-4dd0-a913-ab2d0fa5b293 tempest-GroupSnapshotsTest-1510866578 None] Update group completed successfully.
Apr 29 08:37:18 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.850s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:18 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509
Apr 29 08:37:18 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Flow 'volume_create_manager' (ee41284f-c8d5-4ad2-bf34-ea2654734575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e410d09-e60c-4ea6-9aa4-54db481cf6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ef7a9182-a263-475a-85f3-eb4cc7923509" returned: 0 in 0.694s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e410d09-e60c-4ea6-9aa4-54db481cf6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1872993656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ff51fd-b971-4518-b667-cce7ab94f708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c79f1014a410d94ee6db28bd3b2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:19Z,use_quota=True,user_id='6f03fe73386d48408c9a47aa3ae8d759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7726c98b-81b9-499c-8495-7a9c64992c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7726c98b-81b9-499c-8495-7a9c64992c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb37e39-d26f-4fe6-a5e9-93707ae77a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb37e39-d26f-4fe6-a5e9-93707ae77a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ff51fd-b971-4518-b667-cce7ab94f708', 'volume_name': 'volume-c8ff51fd-b971-4518-b667-cce7ab94f708', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f0ba4d-54b6-4c35-9491-6e8b1bb4f56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f0ba4d-54b6-4c35-9491-6e8b1bb4f56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a15232c-1137-4a14-b3ba-e81b7f426fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:19 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Volume c8ff51fd-b971-4518-b667-cce7ab94f708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ff51fd-b971-4518-b667-cce7ab94f708', 'volume_size': 1}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1872993656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ff51fd-b971-4518-b667-cce7ab94f708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc9c79f1014a410d94ee6db28bd3b2a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:19Z,use_quota=True,user_id='6f03fe73386d48408c9a47aa3ae8d759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Creating volume c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:19 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-ef7a9182-a263-475a-85f3-eb4cc7923509" released by "delete_volume" :: held 1.707s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:19 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 1073741824
Apr 29 08:37:19 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Created reservations ['c050b377-997d-4b21-9066-50470df2aa18', '7367c3d9-0efb-4168-ac09-97f3018f3a42', 'f0f6b089-415b-4d3c-b4d9-195482275459', '1e4de485-56d8-4378-bef2-ff302438ea42'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4dff9ba6-3d57-4ba5-a239-fed3c6accf6a tempest-GroupSnapshotsTest-1510866578 None] Update group completed successfully.
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:19 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:19 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-f68d6faf-3a01-46d8-8e98-8a9e69637430-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-f68d6faf-3a01-46d8-8e98-8a9e69637430-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:20 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.793s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:20 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Deleted volume successfully.
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:20 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-98210b85-35f9-4173-bb5c-6b70fd515291 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-ef7a9182-a263-475a-85f3-eb4cc7923509-delete_volume" released by "delete_volume" :: held 6.999s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 1073741824" returned: 0 in 1.029s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[829b1a4d-8828-4499-b34f-d99d790a274c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:20 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708
Apr 29 08:37:20 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:20 devstack sudo[88488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430
Apr 29 08:37:20 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:21 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] GroupSnapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: creating.
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Group snapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: creating. {{(pid=84102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:21 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708" returned: 0 in 0.724s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.242s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a15232c-1137-4a14-b3ba-e81b7f426fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ff51fd-b971-4518-b667-cce7ab94f708', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9f40ad-34ca-4b7b-b43a-c96e73a0b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Creating offline snapshot 417698e0-5c9d-49f3-b872-ec6653a9af3d of volume 40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:37:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Volume volume-c8ff51fd-b971-4518-b667-cce7ab94f708 (c8ff51fd-b971-4518-b667-cce7ab94f708): created successfully
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9f40ad-34ca-4b7b-b43a-c96e73a0b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:21 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Flow 'volume_create_manager' (ee41284f-c8d5-4ad2-bf34-ea2654734575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5fb0cd-53b8-4844-9edb-2d973dd229eb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430" returned: 0 in 0.863s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:21 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3e5ad198-d3d7-46ca-b608-99a4cff14392 tempest-SnapshotMetadataTestJSON-1795539481 None] Created volume successfully.
Apr 29 08:37:21 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430
Apr 29 08:37:21 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:21 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463
Apr 29 08:37:21 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:22 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f68d6faf-3a01-46d8-8e98-8a9e69637430" returned: 0 in 0.709s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-quobyte-f68d6faf-3a01-46d8-8e98-8a9e69637430" released by "delete_volume" :: held 1.633s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Created reservations ['dfc97e58-a294-44d0-be45-7c28611da6f1', '9b15db3b-3ace-403d-af53-826eb39dabfe', '4c7f24e8-f7db-47d3-8075-5e257bf83c30', '55740925-98b3-4c9c-8975-453b06e73ceb'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:22 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463" returned: 0 in 0.948s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:22 devstack sudo[88505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:22 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:22 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d 1G
Apr 29 08:37:22 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:23 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.756s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:23 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Deleted volume successfully.
Apr 29 08:37:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-128ed37a-37a5-43ab-91f9-c35d90d74ad5 tempest-VolumesDeleteCascade-965036853 None] Lock "cinder-f68d6faf-3a01-46d8-8e98-8a9e69637430-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:23 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d 1G" returned: 0 in 1.096s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40745f22-7f2c-47f0-af03-2e870c362463 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:23 devstack sudo[88514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40745f22-7f2c-47f0-af03-2e870c362463 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d
Apr 29 08:37:23 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:24 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40745f22-7f2c-47f0-af03-2e870c362463 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:24 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:24 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d
Apr 29 08:37:24 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:25 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d" returned: 0 in 0.717s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:25 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info
Apr 29 08:37:25 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:25 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info" returned: 0 in 0.765s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:25 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:26 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info
Apr 29 08:37:26 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:26 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.info" returned: 0 in 0.723s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.334s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Creating offline snapshot 438f14dc-f567-4111-ab2a-8bda362c25e0 of volume c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f9628-7b91-4c99-afa1-f0d9ea992776]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:26 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519
Apr 29 08:37:26 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:27 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519" returned: 0 in 0.838s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:27 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 1G
Apr 29 08:37:27 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Flow 'volume_create_manager' (7dc5d3bf-b42d-4694-80e5-21509c4b8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3f5fcb-2172-4e1d-9667-66a54685a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:28 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3f5fcb-2172-4e1d-9667-66a54685a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1746206123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8fa5d1-b867-43cf-b777-e1a35ab2d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b62a467a29243e39fa0b2cdbdb1d717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:29Z,use_quota=True,user_id='6f296a8216e44e91840d36f2679fc14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36e0421-0654-494d-bc39-f70c432516e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36e0421-0654-494d-bc39-f70c432516e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868bc17a-2636-41f5-80db-7b2bf2c1c79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868bc17a-2636-41f5-80db-7b2bf2c1c79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8fa5d1-b867-43cf-b777-e1a35ab2d610', 'volume_name': 'volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cec19de-ce56-425c-83cf-4882884213b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cec19de-ce56-425c-83cf-4882884213b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cad772-c1e5-4ca7-b5f2-a57b7e1b27dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Volume aa8fa5d1-b867-43cf-b777-e1a35ab2d610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610', 'volume_size': 1}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 1G" returned: 0 in 1.018s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:28 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0
Apr 29 08:37:28 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:29 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0" returned: 0 in 0.644s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:29 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:29 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0
Apr 29 08:37:29 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:29 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:30 devstack sudo[88549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info
Apr 29 08:37:30 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:30 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info" returned: 0 in 0.679s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:30 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:30 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info
Apr 29 08:37:30 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:31 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.info" returned: 0 in 0.606s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.303s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Creating offline snapshot e747fd05-b5e0-49c0-9493-bc3a58dd21f1 of volume c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90832cee-5559-4880-928a-99b1962c3a6c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d516c5e4-6ff6-411a-8b08-c47963c6249d tempest-GroupSnapshotsTest-1510866578 None] group_snapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: created successfully
Apr 29 08:37:31 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708
Apr 29 08:37:31 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] group_snapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: deleting
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] group_snapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: deleting {{(pid=84102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-417698e0-5c9d-49f3-b872-ec6653a9af3d" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-417698e0-5c9d-49f3-b872-ec6653a9af3d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Deleting offline snapshot 417698e0-5c9d-49f3-b872-ec6653a9af3d of volume 40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] snapshot_file for this snap is: volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[193caca4-18ff-4651-b9a5-0c44e19b3c2d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:32 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708" returned: 0 in 0.801s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:32 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d
Apr 29 08:37:32 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:32 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 1G
Apr 29 08:37:32 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:32 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d" returned: 0 in 0.811s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40745f22-7f2c-47f0-af03-2e870c362463(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf872f5-e3ab-4750-a0fb-c6c250d77525]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:33 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463
Apr 29 08:37:33 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:33 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 1G" returned: 0 in 0.880s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ff51fd-b971-4518-b667-cce7ab94f708 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:33 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ff51fd-b971-4518-b667-cce7ab94f708 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1
Apr 29 08:37:33 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:33 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463" returned: 0 in 0.888s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:33 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8ff51fd-b971-4518-b667-cce7ab94f708 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1" returned: 0 in 0.735s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:33 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 is being set with open permissions: ugo+rw
Apr 29 08:37:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:33 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d
Apr 29 08:37:33 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:33 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1
Apr 29 08:37:33 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:34 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1" returned: 0 in 0.655s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:34 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info
Apr 29 08:37:34 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:34 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d" returned: 0 in 0.754s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:34 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d
Apr 29 08:37:34 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:35 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:35 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463.417698e0-5c9d-49f3-b872-ec6653a9af3d" returned: 0 in 0.623s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info" returned: 0 in 0.692s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:35 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info is being set with open permissions: ugo+rw
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-417698e0-5c9d-49f3-b872-ec6653a9af3d" released by "_delete_snapshot" :: held 3.234s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:35 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info
Apr 29 08:37:35 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" released by "delete_snapshot" :: held 3.271s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-438f14dc-f567-4111-ab2a-8bda362c25e0" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-438f14dc-f567-4111-ab2a-8bda362c25e0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Deleting offline snapshot 438f14dc-f567-4111-ab2a-8bda362c25e0 of volume c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] snapshot_file for this snap is: volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd161c-de47-4850-ad75-1ea190744492]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:35 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0
Apr 29 08:37:35 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:35 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.info" returned: 0 in 0.665s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.543s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.184s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1746206123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8fa5d1-b867-43cf-b777-e1a35ab2d610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b62a467a29243e39fa0b2cdbdb1d717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:29Z,use_quota=True,user_id='6f296a8216e44e91840d36f2679fc14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Creating volume aa8fa5d1-b867-43cf-b777-e1a35ab2d610 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:35 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:35 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 1073741824
Apr 29 08:37:35 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5e311055-97d5-498b-9cad-7e9a804ff3d7 tempest-SnapshotMetadataTestJSON-1795539481 None] Create snapshot completed successfully
Apr 29 08:37:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c3e57f5d-0ee8-4c61-b773-dcc1b86fa06f tempest-GroupsV314Test-919873943 None] Group tempest-GroupsV314Test-Group-834966934: creating
Apr 29 08:37:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c3e57f5d-0ee8-4c61-b773-dcc1b86fa06f tempest-GroupsV314Test-919873943 None] Group tempest-GroupsV314Test-Group-834966934: created successfully
Apr 29 08:37:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c3e57f5d-0ee8-4c61-b773-dcc1b86fa06f tempest-GroupsV314Test-919873943 None] Create group completed successfully.
Apr 29 08:37:36 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f99217-5cd9-4d0e-9062-f88821c0b519(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e22705-111d-4a72-8e34-820d693587e5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:36 devstack sudo[88605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519
Apr 29 08:37:36 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:36 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 1073741824" returned: 0 in 0.902s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:36 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610
Apr 29 08:37:36 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:37 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:37 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0
Apr 29 08:37:37 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "cinder-e747fd05-b5e0-49c0-9493-bc3a58dd21f1-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-e747fd05-b5e0-49c0-9493-bc3a58dd21f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "cinder-quobyte-e747fd05-b5e0-49c0-9493-bc3a58dd21f1" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-e747fd05-b5e0-49c0-9493-bc3a58dd21f1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Deleting offline snapshot e747fd05-b5e0-49c0-9493-bc3a58dd21f1 of volume c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:37 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] snapshot_file for this snap is: volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" returned: 0 in 0.735s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd7d792-e301-4d02-a99a-a6965e0071b9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cad772-c1e5-4ca7-b5f2-a57b7e1b27dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea4913-6e93-4136-8ac9-a87a0b7827ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Volume volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 (aa8fa5d1-b867-43cf-b777-e1a35ab2d610): created successfully
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ea4913-6e93-4136-8ac9-a87a0b7827ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Flow 'volume_create_manager' (7dc5d3bf-b42d-4694-80e5-21509c4b8643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:37 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1
Apr 29 08:37:37 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:37 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-814974c5-e6ec-49cf-af48-05dae7e3c5b8 tempest-VolumesTransfersTest-87323965 None] Created volume successfully.
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Flow 'volume_create_manager' (59e39dcf-3f4d-41af-a125-62cb2674eb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d533852c-22fa-45d6-a6c5-7210520c36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d533852c-22fa-45d6-a6c5-7210520c36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-119231477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c602e2b8-13fb-40b0-801c-b32393369e1a,host='devstack@QuobyteHD#QuobyteHD',id=324a3296-a436-4af9-8a1a-d2c02a56ff51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad71d6994464645b9bb2978fde49048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:38Z,use_quota=True,user_id='8421691732d445da8c96749320b67f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f15f2ad-0676-45da-8646-46b2bba3e386),volume_type_id=7f15f2ad-0676-45da-8646-46b2bba3e386)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19ca0d2-c0c0-4806-90b3-c20e566c925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19ca0d2-c0c0-4806-90b3-c20e566c925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e92ee5-c874-4be5-84b8-47fa4ccbfce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e92ee5-c874-4be5-84b8-47fa4ccbfce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '324a3296-a436-4af9-8a1a-d2c02a56ff51', 'volume_name': 'volume-324a3296-a436-4af9-8a1a-d2c02a56ff51', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b482a4-e0a0-4cf6-ae37-d1d7a69b9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b482a4-e0a0-4cf6-ae37-d1d7a69b9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5138669b-cc0c-46b4-a5cf-ac81a82bbb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:37 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Volume 324a3296-a436-4af9-8a1a-d2c02a56ff51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-324a3296-a436-4af9-8a1a-d2c02a56ff51', 'volume_size': 1}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c602e2b8-13fb-40b0-801c-b32393369e1a,created_at=2026-04-29T06:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-119231477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c602e2b8-13fb-40b0-801c-b32393369e1a,host='devstack@QuobyteHD#QuobyteHD',id=324a3296-a436-4af9-8a1a-d2c02a56ff51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad71d6994464645b9bb2978fde49048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:38Z,use_quota=True,user_id='8421691732d445da8c96749320b67f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f15f2ad-0676-45da-8646-46b2bba3e386),volume_type_id=7f15f2ad-0676-45da-8646-46b2bba3e386)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Creating volume 324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:37 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:37 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 1073741824
Apr 29 08:37:37 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:38 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0" returned: 0 in 0.941s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:38 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0
Apr 29 08:37:38 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:38 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1" returned: 0 in 0.894s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8ff51fd-b971-4518-b667-cce7ab94f708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade3801c-40f9-4979-b625-78aef7fb5c74]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:38 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708
Apr 29 08:37:38 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:38 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519.438f14dc-f567-4111-ab2a-8bda362c25e0" returned: 0 in 0.809s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-438f14dc-f567-4111-ab2a-8bda362c25e0" released by "_delete_snapshot" :: held 3.605s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:38 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 1073741824" returned: 0 in 1.001s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" released by "delete_snapshot" :: held 3.642s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:38 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:37:38 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:39 devstack cinder-volume[84102]: WARNING cinder.quota [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-98620950 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-98620950, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:39 devstack cinder-volume[84102]: WARNING cinder.quota [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-98620950 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-98620950, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['b54dfd4e-e03f-4da1-b89d-81060d406b48', '0735a379-da22-45c1-bb19-248b34d78b51', '652192b2-1280-4204-941e-c64b7d79cb84', '84d8ef83-101c-4efc-a3f2-52fa19fdea43'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:39 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a78cd42c-2917-4e55-b883-26c49b667184 tempest-VolumesTransfersTest-1366031789 None] Transfer volume completed successfully.
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['04828768-e349-46fd-aef9-12da505df45a', 'aad0e2e9-6011-46cf-b634-4b6a68b40b9c', '15962d7c-fa29-4928-b40f-30e070214ab1', '1b46bf2b-8f52-4eb4-9785-169068f92abf'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:39 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-24d7280e-c35e-4e70-b377-f22bbd91f7ea tempest-GroupSnapshotsTest-1510866578 None] group_snapshot c9de03ea-587e-48ef-a5f3-25524624bfd4: deleted successfully
Apr 29 08:37:39 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708" returned: 0 in 0.895s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:39 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1
Apr 29 08:37:39 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:39 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.701s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5138669b-cc0c-46b4-a5cf-ac81a82bbb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-324a3296-a436-4af9-8a1a-d2c02a56ff51', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cafe9b-bb13-4bb3-a8ca-1247498e2afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:39 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Volume volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 (324a3296-a436-4af9-8a1a-d2c02a56ff51): created successfully
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cafe9b-bb13-4bb3-a8ca-1247498e2afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Flow 'volume_create_manager' (59e39dcf-3f4d-41af-a125-62cb2674eb3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:39 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5a0eea1a-56a0-4893-899d-3f20c4b351bf tempest-GroupsV314Test-919873943 None] Created volume successfully.
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cd6dca-c652-4be5-be3b-f3b2b8f0ce05]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463
Apr 29 08:37:40 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "cinder-aa8fa5d1-b867-43cf-b777-e1a35ab2d610-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:40 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1" returned: 0 in 0.932s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-aa8fa5d1-b867-43cf-b777-e1a35ab2d610-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:40 devstack sudo[88657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1
Apr 29 08:37:40 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "cinder-quobyte-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-quobyte-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d518e5-d959-46dd-ae6f-e5d1652c118f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610
Apr 29 08:37:40 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:40 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463" returned: 0 in 0.902s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:40 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463
Apr 29 08:37:40 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708.e747fd05-b5e0-49c0-9493-bc3a58dd21f1" returned: 0 in 0.741s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-e747fd05-b5e0-49c0-9493-bc3a58dd21f1" released by "_delete_snapshot" :: held 3.642s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" released by "delete_snapshot" :: held 3.684s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:41 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Cloning volume 324a3296-a436-4af9-8a1a-d2c02a56ff51 to volume b7d3c67f-5b7b-4902-8888-f4ed37ffc550
Apr 29 08:37:41 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" returned: 0 in 0.867s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Creating offline snapshot 10ceff71-c9e3-4dbf-9bff-c3b229e8a078 of volume 324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Created reservations ['054a3f16-b002-4ca6-a775-bdb804a0d81d', 'bfaa24e1-ad12-44ae-9bcb-103b1e0c3699', 'e3ec902f-6144-4805-8e6d-f2cf513176ee', '2db15c8c-9ce6-4b10-920d-13eaeff72a8e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff418790-9d62-4a0f-8d34-50f3e09a04ee]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610
Apr 29 08:37:41 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Delete snapshot completed successfully.
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-11af7de8-c642-4d10-8a14-3dc0a90045e5 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-e747fd05-b5e0-49c0-9493-bc3a58dd21f1-delete_snapshot" released by "delete_snapshot" :: held 4.069s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:41 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:37:41 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-40745f22-7f2c-47f0-af03-2e870c362463" returned: 0 in 0.780s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-40745f22-7f2c-47f0-af03-2e870c362463" released by "delete_volume" :: held 1.759s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcbd433-7308-4440-a21c-0d5f1ecfca22]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:41 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519
Apr 29 08:37:41 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "cinder-c8ff51fd-b971-4518-b667-cce7ab94f708-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-c8ff51fd-b971-4518-b667-cce7ab94f708-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" acquired by "delete_volume" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d56e2-ef65-4e35-a66a-0a4a97ffe1e1]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-quobyte-aa8fa5d1-b867-43cf-b777-e1a35ab2d610" released by "delete_volume" :: held 1.833s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:42 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708
Apr 29 08:37:42 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Created reservations ['a552f624-e4c3-4fcf-9904-b343b594baae', '5a5f8647-d6ac-4a26-94b0-62233780a09f', '8492dc1c-1ae0-4f7f-80c7-25a2a6001c52', 'a87138a7-cf91-45fd-b8b1-be417ea62955'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:42 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 1.029s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 1G
Apr 29 08:37:42 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:42 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:42 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519" returned: 0 in 1.231s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:42 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519
Apr 29 08:37:42 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708" returned: 0 in 1.052s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:43 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708
Apr 29 08:37:43 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.022s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:43 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Deleted volume successfully.
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Flow 'volume_create_manager' (dea03813-a50d-4681-a4e0-55a44c9247b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65febff6-f1fb-4565-af65-5f77b9988d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65febff6-f1fb-4565-af65-5f77b9988d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1420938857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a36c8e-b564-482f-808d-9cf7bee7c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b62a467a29243e39fa0b2cdbdb1d717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:44Z,use_quota=True,user_id='6f296a8216e44e91840d36f2679fc14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b27b65-b38c-4044-916e-68031825dd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b27b65-b38c-4044-916e-68031825dd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37141a3d-9d32-4f09-be54-4ac63ea23327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37141a3d-9d32-4f09-be54-4ac63ea23327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a36c8e-b564-482f-808d-9cf7bee7c7b9', 'volume_name': 'volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cd9689-d03e-437a-bad6-9e9480f0d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cd9689-d03e-437a-bad6-9e9480f0d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf953ed6-8587-40aa-9e85-fbf597f75987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:43 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Volume 99a36c8e-b564-482f-808d-9cf7bee7c7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9', 'volume_size': 1}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4de56dc6-bbb9-4775-8282-ba247631e3ae tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-aa8fa5d1-b867-43cf-b777-e1a35ab2d610-delete_volume" released by "delete_volume" :: held 3.281s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:43 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 1G" returned: 0 in 1.490s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:43 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c3f99217-5cd9-4d0e-9062-f88821c0b519" returned: 0 in 0.994s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:43 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:43 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-c3f99217-5cd9-4d0e-9062-f88821c0b519" released by "delete_volume" :: held 2.309s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['6fce25ae-76ca-4ca6-b371-db0e0cb524d2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:44 devstack cinder-volume[84102]: WARNING cinder.quota [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-98620950 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-98620950, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['ad07b1e5-dc95-4bb2-a4d3-efd9b8295c41', '20f1e1c0-91c5-4b6e-8f2b-a3e3f17fb2fe', 'f9d6b78d-3950-4dd6-8788-31463883458b', 'c236e870-0e17-41f3-9825-a62b39862847'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:44 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8ff51fd-b971-4518-b667-cce7ab94f708" returned: 0 in 1.023s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-quobyte-c8ff51fd-b971-4518-b667-cce7ab94f708" released by "delete_volume" :: held 2.201s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['f0b14e75-78e5-4785-a5ce-893adbf45784', 'ea2f7f5e-d912-48e1-a6ba-7ef3f4d34ac4', '7faf382a-3cb0-4945-be56-642c4008d815', 'c97010d1-60d5-4ab0-9092-2bb1220a0d49'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Created reservations ['66f861d6-3b05-4270-81f4-68776b160c10', '0c95c5f7-f410-45cd-aaa8-a0305eeda757', 'b6635747-e2db-45ed-9056-8deb4a162d16', 'f95fcff2-b7c6-43aa-b0e4-94507ac74ead'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:44 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:44 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:44 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:37:44 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:44 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.978s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:44 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:44 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:44 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6271766a-db7d-462c-9b3c-1d2dbf8f126d tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-1148664108: creating
Apr 29 08:37:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6271766a-db7d-462c-9b3c-1d2dbf8f126d tempest-GroupSnapshotsTest-1510866578 None] Group tempest-GroupSnapshotsTest-Group-1148664108: created successfully
Apr 29 08:37:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6271766a-db7d-462c-9b3c-1d2dbf8f126d tempest-GroupSnapshotsTest-1510866578 None] Create group completed successfully.
Apr 29 08:37:45 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.802s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Deleted volume successfully.
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ea7b5e12-70ac-48f1-9906-2399db0e3724 tempest-SnapshotMetadataTestJSON-1795539481 None] Lock "cinder-c8ff51fd-b971-4518-b667-cce7ab94f708-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:45 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.008s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:37:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8894597e-ed7f-41ca-ac6a-6e10f47dff35 tempest-GroupSnapshotsTest-1510866578 None] Delete group completed successfully.
Apr 29 08:37:45 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.801s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:45 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info
Apr 29 08:37:45 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:46 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info" returned: 0 in 0.668s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:46 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:46 devstack sudo[88725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info
Apr 29 08:37:46 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (5cce1644-7215-4abc-9108-ed0f697759e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a37b3c-bd75-42c7-bf8f-1486dc24b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a37b3c-bd75-42c7-bf8f-1486dc24b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365263751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=69e5a1cb-75d1-4089-b9b1-86a4251ed5c2,host='devstack@QuobyteHD#QuobyteHD',id=02f3faa3-e80a-4bc7-a764-6bcc0d795b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:47Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8e48944-f26a-40f6-8623-f13e7a28bd81),volume_type_id=b8e48944-f26a-40f6-8623-f13e7a28bd81)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32760bfb-e3db-48a4-b555-c126d43749d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32760bfb-e3db-48a4-b555-c126d43749d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83dfd7-57d5-452c-95ff-64dac387d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83dfd7-57d5-452c-95ff-64dac387d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f3faa3-e80a-4bc7-a764-6bcc0d795b80', 'volume_name': 'volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cffe23e-939e-418f-931c-c3c86d57b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cffe23e-939e-418f-931c-c3c86d57b113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3cb14b-1366-43db-beaa-ef0b3c507076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:46 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Volume 02f3faa3-e80a-4bc7-a764-6bcc0d795b80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80', 'volume_size': 1}
Apr 29 08:37:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:47 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.info" returned: 0 in 0.683s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Acquiring lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] snapshot: 10ceff71-c9e3-4dbf-9bff-c3b229e8a078, volume: b7d3c67f-5b7b-4902-8888-f4ed37ffc550,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e39583-4407-48ec-96c5-e27b6adffe5c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:47 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:47 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:47 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.796s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-324a3296-a436-4af9-8a1a-d2c02a56ff51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2061424-59de-4989-813b-096045edb175]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:48 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:37:48 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:48 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.847s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:37:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:48 devstack sudo[88740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550
Apr 29 08:37:48 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" returned: 0 in 5.506s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[81090e2c-31c9-460b-a895-82c9eb29a6d8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:54 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:37:54 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Flow 'volume_create_manager' (5e7155d6-830e-440d-ac44-256fe8469aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28694359-8bc0-45a2-a76b-deb598e5609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28694359-8bc0-45a2-a76b-deb598e5609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1628597482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9bb827-ae8a-4ea4-a56d-f2790805ceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a65909314bc19ebbaa249b2adc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:55Z,use_quota=True,user_id='f72d6f8b9720444e9c3146ec93c5f5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f162ecd7-991c-48f6-8b94-246e0d0f494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f162ecd7-991c-48f6-8b94-246e0d0f494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a191f422-9aef-424c-88ee-f5c1d6b7cfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a191f422-9aef-424c-88ee-f5c1d6b7cfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9bb827-ae8a-4ea4-a56d-f2790805ceea', 'volume_name': 'volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6276bd-98ce-431d-94b7-3340037503b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6276bd-98ce-431d-94b7-3340037503b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386561c-146f-4cda-bdf5-3c88964ebf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:37:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Volume 2b9bb827-ae8a-4ea4-a56d-f2790805ceea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea', 'volume_size': 1}
Apr 29 08:37:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:55 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.942s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:37:55 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Converted 1024.00 MB image at 185.90 MB/s
Apr 29 08:37:55 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:55 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550
Apr 29 08:37:55 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:55 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" returned: 0 in 0.565s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" released by "_copy_volume_from_snapshot" :: held 8.781s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Acquiring lock "cinder-quobyte-10ceff71-c9e3-4dbf-9bff-c3b229e8a078" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-10ceff71-c9e3-4dbf-9bff-c3b229e8a078" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Deleting offline snapshot 10ceff71-c9e3-4dbf-9bff-c3b229e8a078 of volume 324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] snapshot_file for this snap is: volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b722b88-64c1-44dd-85d0-2d4e5ccc82af]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:56 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:56 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:56 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.734s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-324a3296-a436-4af9-8a1a-d2c02a56ff51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:37:56 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd9eec2-2310-4ff9-9e8f-5f3e44853674]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:37:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:56 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:37:56 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:57 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.759s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:57 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:57 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:58 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.761s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:58 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078
Apr 29 08:37:58 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:58 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51.10ceff71-c9e3-4dbf-9bff-c3b229e8a078" returned: 0 in 0.721s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-10ceff71-c9e3-4dbf-9bff-c3b229e8a078" released by "_delete_snapshot" :: held 3.065s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.706s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.362s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1420938857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a36c8e-b564-482f-808d-9cf7bee7c7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b62a467a29243e39fa0b2cdbdb1d717',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:44Z,use_quota=True,user_id='6f296a8216e44e91840d36f2679fc14b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Creating volume 99a36c8e-b564-482f-808d-9cf7bee7c7b9 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:37:59 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:37:59 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 1073741824
Apr 29 08:37:59 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:37:59 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-dc9d93ee-6ba5-4e3a-bdcb-9678454f7fb4 tempest-GroupsV314Test-919873943 None] Create group from source-group-c602e2b8-13fb-40b0-801c-b32393369e1a completed successfully.
Apr 29 08:37:59 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 1073741824" returned: 0 in 0.887s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:37:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9
Apr 29 08:38:00 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Acquiring lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcd0a49-1556-47f5-bdd1-4874cc862b99]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550
Apr 29 08:38:00 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9" returned: 0 in 0.623s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.699s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=69e5a1cb-75d1-4089-b9b1-86a4251ed5c2,created_at=2026-04-29T06:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1365263751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=69e5a1cb-75d1-4089-b9b1-86a4251ed5c2,host='devstack@QuobyteHD#QuobyteHD',id=02f3faa3-e80a-4bc7-a764-6bcc0d795b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f65abf3261c048fdb5958065692aa423',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:47Z,use_quota=True,user_id='58341414d169463bbe954500fc81a501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8e48944-f26a-40f6-8623-f13e7a28bd81),volume_type_id=b8e48944-f26a-40f6-8623-f13e7a28bd81)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Creating volume 02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:00 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 1073741824
Apr 29 08:38:00 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf953ed6-8587-40aa-9e85-fbf597f75987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8926bde8-c25f-4a12-bde5-e613398f5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Volume volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 (99a36c8e-b564-482f-808d-9cf7bee7c7b9): created successfully
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8926bde8-c25f-4a12-bde5-e613398f5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Flow 'volume_create_manager' (dea03813-a50d-4681-a4e0-55a44c9247b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6f76cb14-9096-412d-bbe4-0fec8e0a8944 tempest-VolumesTransfersTest-87323965 None] Created volume successfully.
Apr 29 08:38:00 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" returned: 0 in 0.830s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:00 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550
Apr 29 08:38:00 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "cinder-99a36c8e-b564-482f-808d-9cf7bee7c7b9-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-99a36c8e-b564-482f-808d-9cf7bee7c7b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "cinder-quobyte-99a36c8e-b564-482f-808d-9cf7bee7c7b9" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-quobyte-99a36c8e-b564-482f-808d-9cf7bee7c7b9" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b3c99-42fb-4bcc-ac24-134a1541d303]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:01 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" returned: 0 in 0.725s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-b7d3c67f-5b7b-4902-8888-f4ed37ffc550" released by "delete_volume" :: held 1.608s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:01 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 1073741824" returned: 0 in 1.072s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:01 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9
Apr 29 08:38:01 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:01 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Created reservations ['139506af-699a-4f3f-8ccc-67b2b8428bfd'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:01 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:01 devstack cinder-volume[84102]: WARNING cinder.quota [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-323069189 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-323069189, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:01 devstack cinder-volume[84102]: WARNING cinder.quota [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-323069189 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-323069189, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Created reservations ['968a8364-73b1-4b82-a518-b9535b355ee9', '53c0b68f-d6ab-453d-94b5-a6822b918024', 'f70c09fa-cab2-4c49-9083-34771fe7a923', 'c8305906-87cc-484c-99c2-ca80322be9e6'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:01 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:01 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:02 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" returned: 0 in 0.686s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.641s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1628597482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9bb827-ae8a-4ea4-a56d-f2790805ceea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f63a65909314bc19ebbaa249b2adc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:37:55Z,use_quota=True,user_id='f72d6f8b9720444e9c3146ec93c5f5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Creating volume 2b9bb827-ae8a-4ea4-a56d-f2790805ceea {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:02 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:02 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:02 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea 1073741824
Apr 29 08:38:02 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9" returned: 0 in 0.954s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3cb14b-1366-43db-beaa-ef0b3c507076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db221ca-7b6a-4514-86a4-8ea574dc2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:02 devstack sudo[88856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9
Apr 29 08:38:02 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Acquiring lock "cinder-quobyte-324a3296-a436-4af9-8a1a-d2c02a56ff51" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:02 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Volume volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 (02f3faa3-e80a-4bc7-a764-6bcc0d795b80): created successfully
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db221ca-7b6a-4514-86a4-8ea574dc2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Flow 'volume_create_manager' (5cce1644-7215-4abc-9108-ed0f697759e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-eb3fcd50-10c9-4b99-8932-fe1f115d643d tempest-GroupSnapshotsTest-1510866578 None] Created volume successfully.
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-324a3296-a436-4af9-8a1a-d2c02a56ff51" acquired by "delete_volume" :: waited 0.049s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e499e-fd5f-4d60-8975-b97f4441af7e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:02 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.832s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:02 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-65949345-3544-4885-957b-01d855836b4b tempest-GroupsV314Test-919873943 None] Delete group completed successfully.
Apr 29 08:38:02 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:38:02 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] GroupSnapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: creating.
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Group snapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: creating. {{(pid=84102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:03 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-99a36c8e-b564-482f-808d-9cf7bee7c7b9" returned: 0 in 0.856s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-quobyte-99a36c8e-b564-482f-808d-9cf7bee7c7b9" released by "delete_volume" :: held 1.871s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Created reservations ['d86bfee0-dcc4-41d7-a504-ed93adb480f8', 'aabe0bfa-cd38-4231-9872-6873a7c9d8c8', '052a1caa-28db-4c9e-aadb-c21daab85741', '8bc22060-abbf-4fa3-b892-65b06a8b4057'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:03 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:03 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:03 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.932s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:03 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea 1073741824" returned: 0 in 1.199s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:03 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51
Apr 29 08:38:03 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:03 devstack sudo[88872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea
Apr 29 08:38:03 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:04 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.788s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Deleted volume successfully.
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-976c17d6-bbe9-47a9-8a10-bfc5157eea6d tempest-VolumesTransfersTest-1047057770 None] Lock "cinder-99a36c8e-b564-482f-808d-9cf7bee7c7b9-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:04 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-324a3296-a436-4af9-8a1a-d2c02a56ff51" returned: 0 in 0.840s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Lock "cinder-quobyte-324a3296-a436-4af9-8a1a-d2c02a56ff51" released by "delete_volume" :: held 1.836s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:04 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" returned: 0 in 0.771s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.342s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4386561c-146f-4cda-bdf5-3c88964ebf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544e5e8b-3ad8-4860-b9b7-b6fcb9484718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:04 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Volume volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea (2b9bb827-ae8a-4ea4-a56d-f2790805ceea): created successfully
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544e5e8b-3ad8-4860-b9b7-b6fcb9484718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Flow 'volume_create_manager' (5e7155d6-830e-440d-ac44-256fe8469aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Creating offline snapshot 1f17bbcb-c362-4b83-bcf4-3510da461bed of volume 02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:38:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-77a90fe1-6d37-4117-9949-7fa64fdb694a tempest-AbsoluteLimitsTests-71300776 None] Created volume successfully.
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984df94-8e0d-45b5-982c-cc56a34becfd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Created reservations ['02436716-5650-4911-8745-8bfaf58025c7'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Created reservations ['ef1b1230-81d4-40d5-996f-1897bd786d8b', '0af8bdd1-3e73-46bb-a8ca-fe3c1676f30d', '8367b804-5ef2-40b7-b885-3294128b1232', 'b2cb6a97-283d-468e-bf14-b56a58101d1a'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:04 devstack sudo[88877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80
Apr 29 08:38:04 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:04 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:04 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:05 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" returned: 0 in 1.015s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:05 devstack sudo[88885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed 1G
Apr 29 08:38:05 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:05 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.883s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ae25565e-89ab-4f11-a84d-7cecc7550a5e tempest-GroupsV314Test-919873943 None] Delete group completed successfully.
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Acquiring lock "cinder-2b9bb827-ae8a-4ea4-a56d-f2790805ceea-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "cinder-2b9bb827-ae8a-4ea4-a56d-f2790805ceea-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Acquiring lock "cinder-quobyte-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "cinder-quobyte-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc168c8-1b8e-4ce3-9b30-5b8ba9293fbd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea
Apr 29 08:38:06 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed 1G" returned: 0 in 1.230s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:06 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed
Apr 29 08:38:06 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:06 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" returned: 0 in 0.988s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:07 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea
Apr 29 08:38:07 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:07 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" returned: 0 in 0.702s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "cinder-quobyte-2b9bb827-ae8a-4ea4-a56d-f2790805ceea" released by "delete_volume" :: held 1.753s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:07 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed" returned: 0 in 0.934s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:07 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Created reservations ['20f853f9-fbe4-4adf-8487-af695496f82d', 'bf47b7c2-6fea-46f5-a14e-524cae945583', 'd35fd506-63da-4205-8bf0-a99c8bb0be19', '47226e5d-c555-47c6-996e-ae6cd9f7db5c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:07 devstack sudo[88909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed
Apr 29 08:38:07 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:07 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:07 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed" returned: 0 in 0.993s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:08 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:08 devstack sudo[88915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info
Apr 29 08:38:08 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:08 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.051s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:08 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Deleted volume successfully.
Apr 29 08:38:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6cdaf1ac-f960-4bbc-b1c5-0b4624119233 tempest-AbsoluteLimitsTests-71300776 None] Lock "cinder-2b9bb827-ae8a-4ea4-a56d-f2790805ceea-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:09 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info" returned: 0 in 0.770s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:09 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 08:38:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:09 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info
Apr 29 08:38:09 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:10 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.info" returned: 0 in 0.837s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.983s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1ad6ba42-d0d9-40c1-9648-05c26f5dc0e4 tempest-GroupSnapshotsTest-1510866578 None] group_snapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: created successfully
Apr 29 08:38:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] group_snapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: deleting
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] group_snapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: deleting {{(pid=84102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-1f17bbcb-c362-4b83-bcf4-3510da461bed" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-1f17bbcb-c362-4b83-bcf4-3510da461bed" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Deleting offline snapshot 1f17bbcb-c362-4b83-bcf4-3510da461bed of volume 02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] snapshot_file for this snap is: volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923c623-bf93-4af9-9315-10f393a4b1ce]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:11 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed
Apr 29 08:38:11 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:12 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed" returned: 0 in 1.117s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d55a7-6dee-4f2c-8329-0b68b32e5ba9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:12 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80
Apr 29 08:38:12 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Flow 'volume_create_manager' (c4f53d3b-18a7-45dc-823b-a64a5783d208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c1ad6f-74bb-4a17-822e-daa3a87e3e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c1ad6f-74bb-4a17-822e-daa3a87e3e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-968666842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367d7790-15af-4499-adb3-f2b038bd3d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308839c304a8459ab3c4f9c12194aa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:13Z,use_quota=True,user_id='7c49ad5f23f2478db7f49ec000d625dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa10df7e-9721-4a3b-9f00-21cfab267963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa10df7e-9721-4a3b-9f00-21cfab267963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5e9d60-b89d-4e19-9fd9-0cd9d382cce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5e9d60-b89d-4e19-9fd9-0cd9d382cce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367d7790-15af-4499-adb3-f2b038bd3d22', 'volume_name': 'volume-367d7790-15af-4499-adb3-f2b038bd3d22', 'volume_size': 2}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450699fd-a391-43a0-b390-66184a4679dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450699fd-a391-43a0-b390-66184a4679dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d0746-8ac3-4e60-a142-979829e86d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Volume 367d7790-15af-4499-adb3-f2b038bd3d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367d7790-15af-4499-adb3-f2b038bd3d22', 'volume_size': 2}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-968666842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367d7790-15af-4499-adb3-f2b038bd3d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308839c304a8459ab3c4f9c12194aa08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:13Z,use_quota=True,user_id='7c49ad5f23f2478db7f49ec000d625dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Creating volume 367d7790-15af-4499-adb3-f2b038bd3d22 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:12 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 2147483648 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:13 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 2147483648
Apr 29 08:38:13 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Flow 'volume_create_manager' (99a578dd-a1ce-41a5-bca4-b5a8dd31a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd766234-c977-468a-81d2-b31b98049718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd766234-c977-468a-81d2-b31b98049718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-927765508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868af76c-e66d-40bb-b4ae-58791ab31a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321549c473f64a65b7c0fa50c248ad79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:13Z,use_quota=True,user_id='c712655ebc4d408fb6e6e981e67c3c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937a5455-dbdc-48a1-a446-9475948ebe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937a5455-dbdc-48a1-a446-9475948ebe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aac43df-3aab-4307-afe6-3e1c9c0d50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aac43df-3aab-4307-afe6-3e1c9c0d50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '868af76c-e66d-40bb-b4ae-58791ab31a46', 'volume_name': 'volume-868af76c-e66d-40bb-b4ae-58791ab31a46', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f611e2c-880a-40cf-a6aa-b96b0d1d11f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f611e2c-880a-40cf-a6aa-b96b0d1d11f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4dfa1a-df33-4221-acac-462c5b0d2b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Volume 868af76c-e66d-40bb-b4ae-58791ab31a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-868af76c-e66d-40bb-b4ae-58791ab31a46', 'volume_size': 1}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:13 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" returned: 0 in 1.023s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:13 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed
Apr 29 08:38:13 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 2147483648" returned: 0 in 1.073s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=126,cinder:INSERT=38,cinder:UPDATE=146,cinder:DELETE=11 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=152,cinder:UPDATE=154,cinder:INSERT=34,cinder:DELETE=3 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack sudo[88950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22
Apr 29 08:38:14 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed" returned: 0 in 0.870s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed
Apr 29 08:38:14 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22" returned: 0 in 0.675s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-927765508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=868af76c-e66d-40bb-b4ae-58791ab31a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='321549c473f64a65b7c0fa50c248ad79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:13Z,use_quota=True,user_id='c712655ebc4d408fb6e6e981e67c3c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Creating volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:14 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1d0746-8ac3-4e60-a142-979829e86d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367d7790-15af-4499-adb3-f2b038bd3d22', 'volume_size': 2}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0cfa57-a4cd-4e81-847d-f7efe12e0356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:14 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 1073741824
Apr 29 08:38:14 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:14 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Volume volume-367d7790-15af-4499-adb3-f2b038bd3d22 (367d7790-15af-4499-adb3-f2b038bd3d22): created successfully
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0cfa57-a4cd-4e81-847d-f7efe12e0356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Flow 'volume_create_manager' (c4f53d3b-18a7-45dc-823b-a64a5783d208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80.1f17bbcb-c362-4b83-bcf4-3510da461bed" returned: 0 in 0.719s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-1f17bbcb-c362-4b83-bcf4-3510da461bed" released by "_delete_snapshot" :: held 3.913s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d32ad57d-7600-436f-973c-dff127d41323 tempest-VolumesCloneNegativeTest-1618180429 None] Created volume successfully.
Apr 29 08:38:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" released by "delete_snapshot" :: held 3.964s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:15 devstack cinder-volume[84102]: WARNING cinder.quota [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1405850456 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1405850456, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:15 devstack cinder-volume[84102]: WARNING cinder.quota [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1405850456 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1405850456, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:15 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['5bd82d16-1c81-4d85-9142-5fe5319f853c', 'e2f8e004-6d13-4588-95e9-014821ccf071', '7769585f-bb4e-4703-a559-219f52bcc7cc', 'a695bf27-7f61-4099-b47a-f32d87bebc76'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ad7d8d4d-9d77-429e-93d4-493e628cec96 tempest-GroupSnapshotsTest-1510866578 None] group_snapshot b2c5aa11-7d1f-45b5-865c-28d7822fbdbb: deleted successfully
Apr 29 08:38:15 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 1073741824" returned: 0 in 0.953s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:15 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46
Apr 29 08:38:15 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" acquired by "delete_volume" :: waited 0.045s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3b891-243d-49a4-832f-b4f174e755e4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Acquiring lock "cinder-367d7790-15af-4499-adb3-f2b038bd3d22-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "cinder-367d7790-15af-4499-adb3-f2b038bd3d22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Acquiring lock "cinder-quobyte-367d7790-15af-4499-adb3-f2b038bd3d22" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "cinder-quobyte-367d7790-15af-4499-adb3-f2b038bd3d22" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:16 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80
Apr 29 08:38:16 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7018aa-56ed-41ae-a161-8f0f1a99e19f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:16 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46" returned: 0 in 0.763s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4dfa1a-df33-4221-acac-462c5b0d2b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868af76c-e66d-40bb-b4ae-58791ab31a46', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22
Apr 29 08:38:16 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bddd2ee-60ff-4e7e-b371-e2fe7370588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:16 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Volume volume-868af76c-e66d-40bb-b4ae-58791ab31a46 (868af76c-e66d-40bb-b4ae-58791ab31a46): created successfully
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bddd2ee-60ff-4e7e-b371-e2fe7370588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Flow 'volume_create_manager' (99a578dd-a1ce-41a5-bca4-b5a8dd31a915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:16 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b0444938-4783-4643-b6c8-2303c0c612d0 tempest-SnapshotsActionsTest-626743402 None] Created volume successfully.
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:16 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:16 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:17 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" returned: 0 in 0.957s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:17 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80
Apr 29 08:38:17 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:17 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22" returned: 0 in 1.138s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:17 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.875s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:17 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22
Apr 29 08:38:17 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Creating offline snapshot 455a2996-469a-4bb6-910f-e55d5f3232e9 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44e63a3-e2c5-4e9d-8ed5-1194facf9384]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:18 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46
Apr 29 08:38:18 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:18 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" returned: 0 in 0.989s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Lock "cinder-quobyte-02f3faa3-e80a-4bc7-a764-6bcc0d795b80" released by "delete_volume" :: held 2.071s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['d6b3d0eb-4be4-41ca-9079-339ff8e2f2fb'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:18 devstack cinder-volume[84102]: WARNING cinder.quota [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1405850456 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1405850456, it is now deprecated. Please use the default quota class for default quota.
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Created reservations ['5abb2ac9-efe9-4020-baf7-4ac76eec4a92', 'd537ac49-9c07-48ca-9726-0014b2431860', '0de9aa60-895c-450f-be11-b27c728b2e9b', 'e8c9b28e-3d4a-4cef-a8db-3d0d4d2ad02d'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:18 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:18 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-367d7790-15af-4499-adb3-f2b038bd3d22" returned: 0 in 1.124s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:18 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "cinder-quobyte-367d7790-15af-4499-adb3-f2b038bd3d22" released by "delete_volume" :: held 2.343s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:18 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46" returned: 0 in 0.954s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:18 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 1G
Apr 29 08:38:18 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Created reservations ['7a072c76-c747-425a-a436-6833fca8e40a', '722f8cd6-ccbb-43c6-b026-6cde71a0301a', '65f24ec6-377d-4a5d-858f-036b01dd09ff', 'f5ea4544-e822-4581-b392-9f40732621cf'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:19 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:38:19 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:19 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.756s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-53177c8f-81cb-4c35-8fc8-2266fed7ae58 tempest-GroupSnapshotsTest-1510866578 None] Delete group completed successfully.
Apr 29 08:38:19 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.835s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:38:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Deleted volume successfully.
Apr 29 08:38:19 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 1G" returned: 0 in 1.040s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:20 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:20 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-65014dd6-0150-4412-9e86-bab5f9e3d16c tempest-VolumesCloneNegativeTest-1618180429 None] Lock "cinder-367d7790-15af-4499-adb3-f2b038bd3d22-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:21 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.121s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 is being set with open permissions: ugo+rw
Apr 29 08:38:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:21 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:21 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:21 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.727s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:21 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info
Apr 29 08:38:21 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:22 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info" returned: 0 in 0.799s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:22 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info is being set with open permissions: ugo+rw
Apr 29 08:38:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:22 devstack sudo[89015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info
Apr 29 08:38:22 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:23 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.info" returned: 0 in 1.079s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.880s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7317e204-0c11-44b2-a8af-5ce3801eca53 tempest-SnapshotsActionsTest-626743402 None] Create snapshot completed successfully
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Flow 'volume_create_manager' (958c8c8b-e788-40fb-8a94-d06d2c817119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645a71df-3430-46c5-9da0-988bd3849e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645a71df-3430-46c5-9da0-988bd3849e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-748979089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaa91e9-a3a6-4c89-a956-72527091c0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1d4cd110dc419e82d057c8b02b1c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:25Z,use_quota=True,user_id='b9c80afe5e7648e6a6e73cf0f9a2d37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95fc483-f95b-4700-8ec6-97b40503401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95fc483-f95b-4700-8ec6-97b40503401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7aafbe-2b61-422d-a5c9-967c0b6a783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7aafbe-2b61-422d-a5c9-967c0b6a783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbaa91e9-a3a6-4c89-a956-72527091c0ad', 'volume_name': 'volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3af43c-0b41-4053-a7b1-6a0eaa005546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3af43c-0b41-4053-a7b1-6a0eaa005546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f9bf62-61a7-4d77-a486-eede98620fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Volume dbaa91e9-a3a6-4c89-a956-72527091c0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad', 'volume_size': 1}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-748979089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbaa91e9-a3a6-4c89-a956-72527091c0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1d4cd110dc419e82d057c8b02b1c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:25Z,use_quota=True,user_id='b9c80afe5e7648e6a6e73cf0f9a2d37e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Creating volume dbaa91e9-a3a6-4c89-a956-72527091c0ad {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:25 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:25 devstack sudo[89018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad 1073741824
Apr 29 08:38:25 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:26 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad 1073741824" returned: 0 in 1.161s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:26 devstack sudo[89024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad
Apr 29 08:38:26 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:27 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad" returned: 0 in 0.814s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.942s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Creating offline snapshot 95c69022-2b80-4427-990b-5f23fde5aae7 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f9bf62-61a7-4d77-a486-eede98620fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcedffaf-9137-432d-9683-55ff311de814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[244df150-c82d-45e2-abda-9c0332d37a81]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:27 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Volume volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad (dbaa91e9-a3a6-4c89-a956-72527091c0ad): created successfully
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcedffaf-9137-432d-9683-55ff311de814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Flow 'volume_create_manager' (958c8c8b-e788-40fb-8a94-d06d2c817119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0274c807-9cd5-42db-b653-5e0ebfa03ea2 tempest-VolumesNegativeTest-1353516519 None] Created volume successfully.
Apr 29 08:38:27 devstack sudo[89027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:27 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Flow 'volume_create_manager' (fec7e1eb-9798-4507-a16c-0a894fcfe0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcec38a-afad-49e3-8cfa-4ba98ed1e30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcec38a-afad-49e3-8cfa-4ba98ed1e30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722164760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1de28bc7da441eae022e87cb7efe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:28Z,use_quota=True,user_id='ca7ec9e13bd247c7a4637410d77d92c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07291bf6-5e7e-49b5-927f-4b6e302cc49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07291bf6-5e7e-49b5-927f-4b6e302cc49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0abd7ac-8ecf-4442-ae7d-7fe3407056b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0abd7ac-8ecf-4442-ae7d-7fe3407056b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375', 'volume_name': 'volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bffee6-f702-4ea8-9acd-3d2975b39e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bffee6-f702-4ea8-9acd-3d2975b39e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e32f594-44de-4bfc-80e8-62c3895f50e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375', 'volume_size': 1}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:28 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.961s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:28 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 1G
Apr 29 08:38:28 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:29 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 1G" returned: 0 in 1.087s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:29 devstack sudo[89040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7
Apr 29 08:38:29 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:30 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7" returned: 0 in 0.767s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:30 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 is being set with open permissions: ugo+rw
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:30 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7
Apr 29 08:38:30 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:30 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7" returned: 0 in 0.722s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.682s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722164760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1de28bc7da441eae022e87cb7efe27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:28Z,use_quota=True,user_id='ca7ec9e13bd247c7a4637410d77d92c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Creating volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:30 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:30 devstack sudo[89050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 1073741824
Apr 29 08:38:30 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9a3d0f7a-c626-46ef-be4c-626742261199 tempest-SnapshotsActionsTest-626743402 None] Create snapshot completed successfully
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-95c69022-2b80-4427-990b-5f23fde5aae7-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-95c69022-2b80-4427-990b-5f23fde5aae7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-95c69022-2b80-4427-990b-5f23fde5aae7" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-95c69022-2b80-4427-990b-5f23fde5aae7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Deleting offline snapshot 95c69022-2b80-4427-990b-5f23fde5aae7 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] snapshot_file for this snap is: volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6b3d9e-187b-46cc-8961-784df1b61844]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:32 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 1073741824" returned: 0 in 1.134s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:32 devstack sudo[89056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7
Apr 29 08:38:32 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:32 devstack sudo[89058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:38:32 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:32 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7" returned: 0 in 0.847s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:32 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503cd57-d433-4baa-8d79-e9f7be13c230]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e32f594-44de-4bfc-80e8-62c3895f50e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfa8f97-6ad4-4b08-b6c1-707caebfdd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:32 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Volume volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 (02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375): created successfully
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecfa8f97-6ad4-4b08-b6c1-707caebfdd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Flow 'volume_create_manager' (fec7e1eb-9798-4507-a16c-0a894fcfe0da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8c56d25e-7cb7-40ec-8705-8d9d25140343 tempest-VolumesActionsTest-1587458550 None] Created volume successfully.
Apr 29 08:38:33 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:33 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:33 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.891s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:33 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7
Apr 29 08:38:33 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:35 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7" returned: 0 in 1.272s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:35 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7
Apr 29 08:38:35 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:35 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.95c69022-2b80-4427-990b-5f23fde5aae7" returned: 0 in 0.786s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-95c69022-2b80-4427-990b-5f23fde5aae7" released by "_delete_snapshot" :: held 3.955s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_snapshot" :: held 3.990s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Created reservations ['c3f85f53-5c63-45fa-b586-e77752dbb9b7', '6968a156-7afb-4d65-b7bb-4cc2af9d583c', '8df7eace-3b06-4af2-ad6f-7edd5b9fb54c', '1fcd79e0-db13-40a5-87fd-e83971a9324e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Delete snapshot completed successfully.
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-958d82d1-115e-4bed-a6c2-6c54a99c425b tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-95c69022-2b80-4427-990b-5f23fde5aae7-delete_snapshot" released by "delete_snapshot" :: held 4.273s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Creating offline snapshot 65e2845b-8afb-423f-b0e8-513518570f63 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[27faeb05-04ba-4277-b3dc-b247edc38833]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:37 devstack sudo[89093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:37 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:37 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.038s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:38 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 1G
Apr 29 08:38:38 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:39 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 1G" returned: 0 in 1.070s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:39 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63
Apr 29 08:38:39 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:39 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63" returned: 0 in 0.769s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:39 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 is being set with open permissions: ugo+rw
Apr 29 08:38:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:39 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63
Apr 29 08:38:39 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:40 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63" returned: 0 in 0.657s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.724s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-17db74bd-03bd-4197-a873-652809be927a tempest-SnapshotsActionsTest-626743402 None] Create snapshot completed successfully
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-65e2845b-8afb-423f-b0e8-513518570f63-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-65e2845b-8afb-423f-b0e8-513518570f63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-65e2845b-8afb-423f-b0e8-513518570f63" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-65e2845b-8afb-423f-b0e8-513518570f63" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Deleting offline snapshot 65e2845b-8afb-423f-b0e8-513518570f63 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] snapshot_file for this snap is: volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc030ae-29b3-4524-a1ce-c8365f98d54d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:41 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63
Apr 29 08:38:41 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:42 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63" returned: 0 in 1.168s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c4954-2e42-4576-95a5-2f93d1b553ac]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:42 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:42 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:43 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.002s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:43 devstack sudo[89148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63
Apr 29 08:38:43 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:45 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63" returned: 0 in 1.688s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:45 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63
Apr 29 08:38:45 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:46 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.65e2845b-8afb-423f-b0e8-513518570f63" returned: 0 in 1.318s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-65e2845b-8afb-423f-b0e8-513518570f63" released by "_delete_snapshot" :: held 5.371s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_snapshot" :: held 5.406s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Created reservations ['7d36f1fe-9b60-4974-9d29-e6c424f00859', '274fae15-44d9-436b-a073-0254b0eb4b84', 'cd39a0fc-5e9b-4c52-886d-6187a4601c45', 'cb9fc027-3def-4a2e-8a2f-16e6f81e35f7'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:38:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Delete snapshot completed successfully.
Apr 29 08:38:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-61cbe942-87ec-4acd-a4a4-bddf90420e35 tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-65e2845b-8afb-423f-b0e8-513518570f63-delete_snapshot" released by "delete_snapshot" :: held 5.720s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Creating offline snapshot 2be0965c-85f2-487e-826d-f329a8da8471 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:38:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5acd0-9d38-4b56-a4a7-fcb40dc39be4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:48 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:48 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:50 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.661s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:50 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 1G
Apr 29 08:38:50 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Flow 'volume_create_manager' (d8084bc7-bdc3-4058-b3cf-3fd98c372a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638babbb-4233-4ca3-9d96-68d91d09fed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (638babbb-4233-4ca3-9d96-68d91d09fed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-839136567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5f295-632e-44af-ae88-70045d6c572a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca7d6455f4f47e0829c3a9880c6dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:51Z,use_quota=True,user_id='1f085e1143b4463e82e602b158c9790c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868890d6-2428-4642-b2db-0d0bd7718c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868890d6-2428-4642-b2db-0d0bd7718c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07913e95-d424-46ec-af80-640fcabd3046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:51 devstack cinder-volume[84102]: DEBUG cinder.image.glance [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Creating Keystone auth plugin from conf {{(pid=84102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07913e95-d424-46ec-af80-640fcabd3046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90d5f295-632e-44af-ae88-70045d6c572a', 'volume_name': 'volume-90d5f295-632e-44af-ae88-70045d6c572a', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c84b30>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4520d90-db28-49ff-add7-00d40c5aecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4520d90-db28-49ff-add7-00d40c5aecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68d648-8d84-41fb-9e18-e8540b33ce0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:38:52 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Volume 90d5f295-632e-44af-ae88-70045d6c572a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90d5f295-632e-44af-ae88-70045d6c572a', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c84b30>}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Trying to clone 90d5f295-632e-44af-ae88-70045d6c572a from image 000942db-1254-4464-b86b-8409e1be6077 at location (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]). {{(pid=84102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 08:38:52 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 1G" returned: 0 in 2.316s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:52 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471
Apr 29 08:38:52 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:38:52 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589ec90-0901-4bfb-9953-66da9f6100aa]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:52 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD
Apr 29 08:38:53 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:53 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471" returned: 0 in 1.273s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:53 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 is being set with open permissions: ugo+rw
Apr 29 08:38:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:53 devstack sudo[89356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471
Apr 29 08:38:53 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:54 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD" returned: 0 in 1.446s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 is fetched for user 1f085e1143b4463e82e602b158c9790c. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a6832-63fd-4dca-ba63-9f51f1438a14]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:54 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD
Apr 29 08:38:54 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-32235af1-749e-4347-a059-816cb0bc2d39 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" by "attach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-32235af1-749e-4347-a059-816cb0bc2d39 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" acquired by "attach_volume" :: waited 0.066s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:54 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471" returned: 0 in 1.148s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.699s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ad21f9b9-86c9-42b9-8ea4-f58e1fd88ea8 tempest-SnapshotsActionsTest-626743402 None] Create snapshot completed successfully
Apr 29 08:38:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-32235af1-749e-4347-a059-816cb0bc2d39 tempest-VolumesActionsTest-1587458550 None] Attaching volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 to instance 80a78bbf-0981-487e-8271-bada1b78b028 at mountpoint /dev/vdb on host None.
Apr 29 08:38:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-32235af1-749e-4347-a059-816cb0bc2d39 tempest-VolumesActionsTest-1587458550 None] Attach volume completed successfully.
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-32235af1-749e-4347-a059-816cb0bc2d39 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" released by "attach_volume" :: held 0.402s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:55 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD" returned: 0 in 1.161s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-839136567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5f295-632e-44af-ae88-70045d6c572a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bca7d6455f4f47e0829c3a9880c6dfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:38:51Z,use_quota=True,user_id='1f085e1143b4463e82e602b158c9790c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Creating volume 90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:38:55 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:55 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1073741824
Apr 29 08:38:55 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5dedaa9b-780a-4582-a76b-761d4505b3ca tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" by "detach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5dedaa9b-780a-4582-a76b-761d4505b3ca tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5dedaa9b-780a-4582-a76b-761d4505b3ca tempest-VolumesActionsTest-1587458550 None] Detaching volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 from instance 80a78bbf-0981-487e-8271-bada1b78b028.
Apr 29 08:38:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5dedaa9b-780a-4582-a76b-761d4505b3ca tempest-VolumesActionsTest-1587458550 None] Detach volume completed successfully.
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5dedaa9b-780a-4582-a76b-761d4505b3ca tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-2be0965c-85f2-487e-826d-f329a8da8471-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-2be0965c-85f2-487e-826d-f329a8da8471-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-2be0965c-85f2-487e-826d-f329a8da8471" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-2be0965c-85f2-487e-826d-f329a8da8471" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Deleting offline snapshot 2be0965c-85f2-487e-826d-f329a8da8471 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] snapshot_file for this snap is: volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59bf47f-7a05-4a55-90fd-16796c578281]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:56 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471
Apr 29 08:38:56 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:56 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1073741824" returned: 0 in 0.994s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:56 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:38:56 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:57 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471" returned: 0 in 1.069s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae89d6-56d9-4a7c-978f-a41658ba8689]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:57 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 0 in 0.918s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:38:57 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:38:57 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Attempting download of 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume 90d5f295-632e-44af-ae88-70045d6c572a. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[89439148-46e5-4f27-b1f6-dc19eff0f6b7]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:57 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j
Apr 29 08:38:57 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:58 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.261s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:38:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:58 devstack sudo[89461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471
Apr 29 08:38:58 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:58 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j" returned: 0 in 1.032s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:58 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j
Apr 29 08:38:58 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:59 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471" returned: 0 in 0.929s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:59 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471
Apr 29 08:38:59 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:38:59 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j" returned: 1 in 0.877s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_bj2dxb4j' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[710de6e3-9343-4c3a-8ca2-8db37e84dc41]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:38:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:38:59 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD
Apr 29 08:38:59 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:00 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.2be0965c-85f2-487e-826d-f329a8da8471" returned: 0 in 0.939s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:00 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-2be0965c-85f2-487e-826d-f329a8da8471" released by "_delete_snapshot" :: held 4.337s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] 000942db-1254-4464-b86b-8409e1be6077 was qcow2, converting to raw {{(pid=84102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_snapshot" :: held 4.381s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:00 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:00 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Created reservations ['c2049d69-6ff4-4036-b8cc-0e1a029ac74f', '17f13e52-e6fb-41a8-81b5-5e6e49952e13', 'c120bee8-3f4d-44e8-9f03-7fd8bd4d7227', 'bf31a19e-59a1-47fd-adcb-eacddd725d1c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Delete snapshot completed successfully.
Apr 29 08:39:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-37c1a08a-819a-4e47-aa89-9eda66f5fceb tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-2be0965c-85f2-487e-826d-f329a8da8471-delete_snapshot" released by "delete_snapshot" :: held 4.552s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Creating offline snapshot f4ae4177-1144-4600-abf6-aaadeab3cf08 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:39:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa15f4fa-511f-4882-a816-7983276c9026]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:02 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:39:02 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:02 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:02 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 1G
Apr 29 08:39:02 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:02 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 0 in 2.437s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_8j3lc6kcdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:39:02 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Converted 112.00 MB image at 45.92 MB/s
Apr 29 08:39:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:03 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1G
Apr 29 08:39:03 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:03 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a 1G" returned: 0 in 0.846s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:03 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f51d35-ef9b-47a7-8384-a278ecc644f0]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 1G" returned: 0 in 1.008s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:03 devstack sudo[89512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08
Apr 29 08:39:03 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:04 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:04 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:04 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 0 in 0.934s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:04 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08" returned: 0 in 0.962s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:04 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 is being set with open permissions: ugo+rw
Apr 29 08:39:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:04 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08
Apr 29 08:39:04 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:04 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:04 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:05 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08" returned: 0 in 0.729s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.740s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Acquiring lock "cinder-dbaa91e9-a3a6-4c89-a956-72527091c0ad-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:05 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 1 in 0.850s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Downloaded image 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume 90d5f295-632e-44af-ae88-70045d6c572a successfully. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 for user 1f085e1143b4463e82e602b158c9790c is deleted. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Marking volume 90d5f295-632e-44af-ae88-70045d6c572a as bootable. {{(pid=84102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:39:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4c98f7f0-0084-40e4-a046-63b56fffd8f3 tempest-SnapshotsActionsTest-626743402 None] Create snapshot completed successfully
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "cinder-dbaa91e9-a3a6-4c89-a956-72527091c0ad-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Copying metadata from image 000942db-1254-4464-b86b-8409e1be6077 to 90d5f295-632e-44af-ae88-70045d6c572a. {{(pid=84102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Creating volume glance metadata for volume 90d5f295-632e-44af-ae88-70045d6c572a backed by image 000942db-1254-4464-b86b-8409e1be6077 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Acquiring lock "cinder-quobyte-dbaa91e9-a3a6-4c89-a956-72527091c0ad" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "cinder-quobyte-dbaa91e9-a3a6-4c89-a956-72527091c0ad" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b1008-908f-4420-9a29-da3e6da11af7]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68d648-8d84-41fb-9e18-e8540b33ce0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d5f295-632e-44af-ae88-70045d6c572a', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c84b30>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9254f3-72fc-4649-be28-64c6c54c3d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:05 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Volume volume-90d5f295-632e-44af-ae88-70045d6c572a (90d5f295-632e-44af-ae88-70045d6c572a): created successfully
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9254f3-72fc-4649-be28-64c6c54c3d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Flow 'volume_create_manager' (d8084bc7-bdc3-4058-b3cf-3fd98c372a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cee0ee8e-1f36-4e9d-a503-9226a2b8d339 tempest-VolumesImageMetadata-232591151 None] Created volume successfully.
Apr 29 08:39:05 devstack sudo[89531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad
Apr 29 08:39:05 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-f4ae4177-1144-4600-abf6-aaadeab3cf08-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-f4ae4177-1144-4600-abf6-aaadeab3cf08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Acquiring lock "cinder-quobyte-f4ae4177-1144-4600-abf6-aaadeab3cf08" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-f4ae4177-1144-4600-abf6-aaadeab3cf08" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Deleting offline snapshot f4ae4177-1144-4600-abf6-aaadeab3cf08 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] snapshot_file for this snap is: volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb9cb7-06a3-420c-9d89-ed4744b85c6e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:06 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08
Apr 29 08:39:06 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:06 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad" returned: 0 in 0.795s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:06 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad
Apr 29 08:39:06 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Acquiring lock "cinder-90d5f295-632e-44af-ae88-70045d6c572a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "cinder-90d5f295-632e-44af-ae88-70045d6c572a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Acquiring lock "cinder-quobyte-90d5f295-632e-44af-ae88-70045d6c572a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "cinder-quobyte-90d5f295-632e-44af-ae88-70045d6c572a" acquired by "delete_volume" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[226896e0-45f9-4fb4-990a-d3ca27aa8d81]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08" returned: 0 in 0.914s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:07 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:07 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbae2a8-7118-459c-ba94-0c674721b4fc]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbaa91e9-a3a6-4c89-a956-72527091c0ad" returned: 0 in 0.723s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "cinder-quobyte-dbaa91e9-a3a6-4c89-a956-72527091c0ad" released by "delete_volume" :: held 1.572s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Created reservations ['a36ff808-c570-4f65-8d40-0cf733f1a74f', 'dcdd33eb-64d4-4ed7-9065-58dc4d6c1502', '6ff701c6-4e16-4dfe-a586-19fff5537026', '7a63029e-4980-458b-b98e-bca075e5147e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:07 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:39:07 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:07 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:07 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:07 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 0 in 0.744s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:08 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:08 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:08 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:08 devstack sudo[89559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08
Apr 29 08:39:08 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:08 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.864s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Deleted volume successfully.
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86095818-ee17-43f6-a34b-ccc61a5d96b1 tempest-VolumesNegativeTest-1353516519 None] Lock "cinder-dbaa91e9-a3a6-4c89-a956-72527091c0ad-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:08 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 1 in 0.932s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:39:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:08 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a
Apr 29 08:39:08 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:09 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08" returned: 0 in 1.097s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:09 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08
Apr 29 08:39:09 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:09 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-90d5f295-632e-44af-ae88-70045d6c572a" returned: 0 in 0.789s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "cinder-quobyte-90d5f295-632e-44af-ae88-70045d6c572a" released by "delete_volume" :: held 2.542s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Created reservations ['6fef419f-71a3-4050-8fff-5814681a56e4', '41c2c31b-4399-493f-ae68-4c86d20416f3', '59cc91c9-5cd6-45c4-9ad1-760ec5fb1baf', '44098c13-5a54-4036-b944-856707737e15'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:09 devstack sudo[89572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:09 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:10 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.f4ae4177-1144-4600-abf6-aaadeab3cf08" returned: 0 in 0.908s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-f4ae4177-1144-4600-abf6-aaadeab3cf08" released by "_delete_snapshot" :: held 3.965s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_snapshot" :: held 4.004s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Created reservations ['af3eae50-7be1-4183-ab5c-ca1e57969d82', '5b95ecf8-8ee8-45db-ac6f-3751a7bbc847', '8ff1d2a6-cfc2-4426-9b35-3b0e1269c939', 'd9c460f4-f83b-4052-aad1-2ec29b8f8996'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Delete snapshot completed successfully.
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a0b14d6c-8882-42a9-a075-7db562cd68de tempest-SnapshotsActionsTest-1490582323 None] Lock "cinder-f4ae4177-1144-4600-abf6-aaadeab3cf08-delete_snapshot" released by "delete_snapshot" :: held 4.239s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:10 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.862s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Deleted volume successfully.
Apr 29 08:39:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-79c890d4-711d-4eb3-9838-8b8a8ca9c98d tempest-VolumesImageMetadata-232591151 None] Lock "cinder-90d5f295-632e-44af-ae88-70045d6c572a-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "cinder-455a2996-469a-4bb6-910f-e55d5f3232e9-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-455a2996-469a-4bb6-910f-e55d5f3232e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "cinder-quobyte-455a2996-469a-4bb6-910f-e55d5f3232e9" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-455a2996-469a-4bb6-910f-e55d5f3232e9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Deleting offline snapshot 455a2996-469a-4bb6-910f-e55d5f3232e9 of volume 868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] snapshot_file for this snap is: volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ee2ff-b47f-4325-814e-2340143abb6c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:11 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:39:11 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (53320410-25ae-4f5a-87af-07a9669b2223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdbd51b-31de-4557-9595-f568731efd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdbd51b-31de-4557-9595-f568731efd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-307991820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9715ee4e-0701-46cc-97d9-c9b8a2c40d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:12Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39c164-dc59-4149-919e-24834130ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39c164-dc59-4149-919e-24834130ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f8e75e-3efb-4bb2-b03f-2a9a51e6589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f8e75e-3efb-4bb2-b03f-2a9a51e6589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9715ee4e-0701-46cc-97d9-c9b8a2c40d05', 'volume_name': 'volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c423786-6b5b-45e6-b6e6-207bdc33ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c423786-6b5b-45e6-b6e6-207bdc33ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec39c85-5565-4755-b38c-ee39aee2b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 9715ee4e-0701-46cc-97d9-c9b8a2c40d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05', 'volume_size': 1}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-307991820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9715ee4e-0701-46cc-97d9-c9b8a2c40d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:12Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:11 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:11 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 1073741824
Apr 29 08:39:11 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:12 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 1.221s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-868af76c-e66d-40bb-b4ae-58791ab31a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:12 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6f1d4-5e68-401b-99e2-a09cf3593832]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:12 devstack sudo[89611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46
Apr 29 08:39:12 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:13 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 1073741824" returned: 0 in 1.216s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:13 devstack sudo[89615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05
Apr 29 08:39:13 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:13 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46" returned: 0 in 0.849s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:13 devstack sudo[89620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:39:13 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:13 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" returned: 0 in 0.778s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec39c85-5565-4755-b38c-ee39aee2b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a4e29b-8c17-4f7c-98c4-a0164e0dde40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 (9715ee4e-0701-46cc-97d9-c9b8a2c40d05): created successfully
Apr 29 08:39:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a4e29b-8c17-4f7c-98c4-a0164e0dde40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (53320410-25ae-4f5a-87af-07a9669b2223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d258e1f8-a855-4240-a890-26fb1741ebe7 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:14 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.921s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:14 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9
Apr 29 08:39:14 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:15 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46.455a2996-469a-4bb6-910f-e55d5f3232e9" returned: 0 in 0.682s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=79,cinder:INSERT=34,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=81,cinder:DELETE=8,cinder:SELECT=92,cinder:INSERT=25 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-455a2996-469a-4bb6-910f-e55d5f3232e9" released by "_delete_snapshot" :: held 3.900s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_snapshot" :: held 3.945s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating offline snapshot ced731fb-97f2-4bff-89ef-4a5f564c9098 of volume 9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9f2183-a9ac-4c79-aab3-979578c6ddcd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Created reservations ['a67bdd47-af4b-41f8-8f73-b9f2d8cffe02', '0fab5817-e8dd-4916-9774-3321bc2a8a4c', '5ca6498e-0d58-4c73-ace3-28eed15b77e2', '97b72a90-9833-422b-a074-bcc22968c9c3'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:15 devstack sudo[89629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05
Apr 29 08:39:15 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Delete snapshot completed successfully.
Apr 29 08:39:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e3c56f26-5992-4622-b5c6-81b41fd24de0 tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-455a2996-469a-4bb6-910f-e55d5f3232e9-delete_snapshot" released by "delete_snapshot" :: held 4.250s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:16 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" returned: 0 in 0.852s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:16 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 1G
Apr 29 08:39:16 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Flow 'volume_create_manager' (738275ab-94d6-47f3-bd1f-5dc03bd422af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13884cbf-a6fd-4a62-a9c5-acd3f6080e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "cinder-868af76c-e66d-40bb-b4ae-58791ab31a46-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13884cbf-a6fd-4a62-a9c5-acd3f6080e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-591847325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394ad5f9-96a9-4cf5-88eb-7e0e9c44637c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6992f586f6b411cb8f1fdd248371150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:17Z,use_quota=True,user_id='d14d65083d5d4212b47d0fcdc6033a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494e7886-c2b4-45d2-9af6-3f5eec4db3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494e7886-c2b4-45d2-9af6-3f5eec4db3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77bb34-c956-4cad-b298-0283d5eb67db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba77bb34-c956-4cad-b298-0283d5eb67db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394ad5f9-96a9-4cf5-88eb-7e0e9c44637c', 'volume_name': 'volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14faf2d-1278-4685-b075-d6459f4b0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14faf2d-1278-4685-b075-d6459f4b0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf2487c-5b68-4f55-ab3e-2e5f49f9962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:16 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Volume 394ad5f9-96a9-4cf5-88eb-7e0e9c44637c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c', 'volume_size': 1}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-868af76c-e66d-40bb-b4ae-58791ab31a46-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:16 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:16 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4b190-d020-4c10-8ccb-5904d092acda]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46
Apr 29 08:39:17 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 1G" returned: 0 in 0.898s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098
Apr 29 08:39:17 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.687s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:17 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46" returned: 0 in 0.786s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46
Apr 29 08:39:17 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:17 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098" returned: 0 in 0.689s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:17 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 is being set with open permissions: ugo+rw
Apr 29 08:39:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:17 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098
Apr 29 08:39:17 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:18 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-868af76c-e66d-40bb-b4ae-58791ab31a46" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:18 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-quobyte-868af76c-e66d-40bb-b4ae-58791ab31a46" released by "delete_volume" :: held 1.798s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Created reservations ['fedc11c6-652f-4041-b353-5dea7b567471', 'eac4a73c-c299-4933-a1f9-22cbc52b9f66', '2e30846a-1997-4b78-9448-a83c5779afb3', 'f2cff12f-f73b-4b9b-8473-a2db8c8e19e8'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:18 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info
Apr 29 08:39:18 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:18 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:18 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:19 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info" returned: 0 in 1.086s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:19 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info is being set with open permissions: ugo+rw
Apr 29 08:39:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:19 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info
Apr 29 08:39:19 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:19 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.999s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:19 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Deleted volume successfully.
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e890940-1b7e-4f7f-af4e-fb4134b7f3ef tempest-SnapshotsActionsTest-626743402 None] Lock "cinder-868af76c-e66d-40bb-b4ae-58791ab31a46-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:20 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.info" returned: 0 in 0.768s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.378s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.895s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-591847325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394ad5f9-96a9-4cf5-88eb-7e0e9c44637c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6992f586f6b411cb8f1fdd248371150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:17Z,use_quota=True,user_id='d14d65083d5d4212b47d0fcdc6033a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Creating volume 394ad5f9-96a9-4cf5-88eb-7e0e9c44637c {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:20 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:20 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-20ba5a33-9cfd-4081-89cf-bb3f184ea999 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Create snapshot completed successfully
Apr 29 08:39:20 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c 1073741824
Apr 29 08:39:20 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:22 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c 1073741824" returned: 0 in 1.623s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (d929976a-dd31-4b0e-9f0a-0a5b0d8bd8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5256e093-c482-41a4-9f7d-0a07e0468b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5256e093-c482-41a4-9f7d-0a07e0468b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989208005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7e4a3e-9db7-48a4-9700-eeb061f0aef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:22Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e28e5-ee20-4e0d-b01a-30c094797665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e28e5-ee20-4e0d-b01a-30c094797665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e054a2-bc0d-4f66-a5ef-ae5bb2c6b50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e054a2-bc0d-4f66-a5ef-ae5bb2c6b50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7e4a3e-9db7-48a4-9700-eeb061f0aef5', 'volume_name': 'volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c3d29-d12d-4bd4-beb3-da4e030ffa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23c3d29-d12d-4bd4-beb3-da4e030ffa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9c52d4-b234-46bd-b649-89d44d9d17e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 1f7e4a3e-9db7-48a4-9700-eeb061f0aef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5', 'volume_size': 1}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:22 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c
Apr 29 08:39:22 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-346c88da-77a7-42d1-a420-3df2a2241ed4 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" by "attach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-346c88da-77a7-42d1-a420-3df2a2241ed4 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" acquired by "attach_volume" :: waited 0.095s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (291cc4d6-1c0c-400a-b8e5-2f2ed7851889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:23 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99562e1-673e-4a0a-89f5-5e93679cb7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" returned: 0 in 0.892s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] <== create_volume: return (2703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.713s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989208005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7e4a3e-9db7-48a4-9700-eeb061f0aef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:22Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99562e1-673e-4a0a-89f5-5e93679cb7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736435805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1bee13-5e05-473f-986d-74f2ac4ac5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:23Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack sudo[89746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 1073741824
Apr 29 08:39:23 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce03795-cac1-476f-bb71-4910cad9986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce03795-cac1-476f-bb71-4910cad9986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ec06a-c892-405e-b7d6-d8905825fe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ec06a-c892-405e-b7d6-d8905825fe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1bee13-5e05-473f-986d-74f2ac4ac5ad', 'volume_name': 'volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e367c-2a86-4a19-b696-38cd58acf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080e367c-2a86-4a19-b696-38cd58acf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b65a69-c973-41ce-ac12-2b559e06b340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 1c1bee13-5e05-473f-986d-74f2ac4ac5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad', 'volume_size': 1}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf2487c-5b68-4f55-ab3e-2e5f49f9962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4aa903-f072-462a-b977-389a010d4e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Volume volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c (394ad5f9-96a9-4cf5-88eb-7e0e9c44637c): created successfully
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb4aa903-f072-462a-b977-389a010d4e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Flow 'volume_create_manager' (738275ab-94d6-47f3-bd1f-5dc03bd422af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-346c88da-77a7-42d1-a420-3df2a2241ed4 tempest-VolumesActionsTest-1587458550 None] Attaching volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 to instance 1d662f1c-0ab5-4b2d-800c-1ee706783d3e at mountpoint /dev/vdb on host None.
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0eb64a9b-2957-47ee-8853-fea6d4884252 tempest-VolumesTransfersV355Test-1626923475 None] Created volume successfully.
Apr 29 08:39:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-346c88da-77a7-42d1-a420-3df2a2241ed4 tempest-VolumesActionsTest-1587458550 None] Attach volume completed successfully.
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-346c88da-77a7-42d1-a420-3df2a2241ed4 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" released by "attach_volume" :: held 0.594s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (cd8bdf06-d764-4743-ab89-e8c39b7cb48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa2e3ac-4c3b-4606-9df3-527a4557348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa2e3ac-4c3b-4606-9df3-527a4557348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506045613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fba61dd-976c-433b-9ab4-db5f3b2ba337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:24Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b904f465-a583-4240-af3f-e649119aed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b904f465-a583-4240-af3f-e649119aed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb0f8b4-00a3-4a88-b505-6a66be0806ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb0f8b4-00a3-4a88-b505-6a66be0806ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fba61dd-976c-433b-9ab4-db5f3b2ba337', 'volume_name': 'volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0825682-777f-4fd2-b695-621731a32660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0825682-777f-4fd2-b695-621731a32660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcc643c-2917-4e96-b242-d3c0f08178e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 3fba61dd-976c-433b-9ab4-db5f3b2ba337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337', 'volume_size': 1}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (4282d81f-0915-4b51-8c7e-ed0ea69120fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b31be5-8e23-430b-99e5-94c97b9b2da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b31be5-8e23-430b-99e5-94c97b9b2da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448436393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:24Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ad81a5-137f-4a30-b3fe-4c44ceb36cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ad81a5-137f-4a30-b3fe-4c44ceb36cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3dd8ba-d6b0-4cf3-83c5-903ae5f0dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3dd8ba-d6b0-4cf3-83c5-903ae5f0dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe', 'volume_name': 'volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c38d83-a75d-474c-8beb-140a39869ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c38d83-a75d-474c-8beb-140a39869ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1e0dc0-ef22-410f-a5d4-3e02369e8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe', 'volume_size': 1}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dbbff7b0-85fb-45db-8beb-08182573f529 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" by "detach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dbbff7b0-85fb-45db-8beb-08182573f529 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-dbbff7b0-85fb-45db-8beb-08182573f529 tempest-VolumesActionsTest-1587458550 None] Detaching volume 02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 from instance 1d662f1c-0ab5-4b2d-800c-1ee706783d3e.
Apr 29 08:39:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-dbbff7b0-85fb-45db-8beb-08182573f529 tempest-VolumesActionsTest-1587458550 None] Detach volume completed successfully.
Apr 29 08:39:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dbbff7b0-85fb-45db-8beb-08182573f529 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:25 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 1073741824" returned: 0 in 1.637s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:25 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5
Apr 29 08:39:25 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (76f79df4-4686-4b59-ae49-f088820bc18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2729ccea-02fe-463a-8e07-4861477073db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2729ccea-02fe-463a-8e07-4861477073db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821102037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6832e9b9-d84e-4891-b436-d1aa1528b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:25Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc5d8af-dfee-4e80-ac98-cd334b7f82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc5d8af-dfee-4e80-ac98-cd334b7f82ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8f037-adcd-400c-af54-e6f0e8bd0a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be8f037-adcd-400c-af54-e6f0e8bd0a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6832e9b9-d84e-4891-b436-d1aa1528b9fc', 'volume_name': 'volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6309988-c68c-440f-8b50-c0fd77a6d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6309988-c68c-440f-8b50-c0fd77a6d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1b578-500a-443a-a956-e947b5cc11bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume 6832e9b9-d84e-4891-b436-d1aa1528b9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc', 'volume_size': 1}
Apr 29 08:39:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:26 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" returned: 0 in 0.966s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (2681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.579s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-736435805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1bee13-5e05-473f-986d-74f2ac4ac5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:23Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 1c1bee13-5e05-473f-986d-74f2ac4ac5ad {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:26 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9c52d4-b234-46bd-b649-89d44d9d17e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a5b089-e6be-4ddf-8ace-375a64d2a723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:26 devstack sudo[89754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad 1073741824
Apr 29 08:39:26 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 (1f7e4a3e-9db7-48a4-9700-eeb061f0aef5): created successfully
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a5b089-e6be-4ddf-8ace-375a64d2a723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (d929976a-dd31-4b0e-9f0a-0a5b0d8bd8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:26 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ac333a52-3482-4cd5-ad47-cd8f6ab1cd21 tempest-VolumesTransfersV355Test-79615671 None] Transfer volume completed successfully.
Apr 29 08:39:26 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-85a05a06-2064-4212-9a5a-4c545f747c65 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:27 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad 1073741824" returned: 0 in 1.258s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:27 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad
Apr 29 08:39:27 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "cinder-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "cinder-quobyte-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-quobyte-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60ba68-23e0-47f5-9f83-5b5fdd871614]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:28 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c
Apr 29 08:39:28 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:28 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" returned: 0 in 0.887s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.291s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506045613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fba61dd-976c-433b-9ab4-db5f3b2ba337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:24Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 3fba61dd-976c-433b-9ab4-db5f3b2ba337 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:28 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:28 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 1073741824
Apr 29 08:39:28 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b65a69-c973-41ce-ac12-2b559e06b340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5302d31-ecfd-4211-a787-3e520f9d116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad (1c1bee13-5e05-473f-986d-74f2ac4ac5ad): created successfully
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5302d31-ecfd-4211-a787-3e520f9d116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (291cc4d6-1c0c-400a-b8e5-2f2ed7851889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:28 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-02797612-6a6a-4554-a6a7-0c8bc1c85a81 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:28 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" returned: 0 in 1.013s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:29 devstack sudo[89811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c
Apr 29 08:39:29 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:29 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 1073741824" returned: 0 in 1.037s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:29 devstack sudo[89816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337
Apr 29 08:39:29 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:29 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" returned: 0 in 0.700s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-quobyte-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c" released by "delete_volume" :: held 1.783s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Created reservations ['ba1d3bdc-1d71-4d0f-aae0-48351f2debb3', 'c91d30b4-866f-42b1-895c-4e6ae07ab0c4', '374a10d3-4b09-448b-914d-e91e30892cb5', '34429bbc-33a4-46df-a723-aa9d35ca73e6'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:29 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:29 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337" returned: 0 in 0.752s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.534s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1448436393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:24Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:30 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcc643c-2917-4e96-b242-d3c0f08178e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe 1073741824
Apr 29 08:39:30 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92b1fa-35ec-4edb-a7d3-a45e6c74ae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 (3fba61dd-976c-433b-9ab4-db5f3b2ba337): created successfully
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92b1fa-35ec-4edb-a7d3-a45e6c74ae4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (cd8bdf06-d764-4743-ab89-e8c39b7cb48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-04e30c6d-5a6f-451b-932b-573e76cb0575 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:30 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.819s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Deleted volume successfully.
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-96c32f9e-4450-40e3-a313-3d5af2fcc263 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-394ad5f9-96a9-4cf5-88eb-7e0e9c44637c-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Flow 'volume_create_manager' (f3e92a9a-4ffa-47e0-8fcb-092c4b9ae209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f08578b-5ff1-4480-b9a8-eb57030856bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f08578b-5ff1-4480-b9a8-eb57030856bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-84892927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07651d70-45dd-47fa-bf00-35babf400dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6992f586f6b411cb8f1fdd248371150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:31Z,use_quota=True,user_id='d14d65083d5d4212b47d0fcdc6033a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8188456c-b300-4eba-a584-029859c57b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8188456c-b300-4eba-a584-029859c57b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7527642-6f14-4f8f-be66-f53f6f3e646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7527642-6f14-4f8f-be66-f53f6f3e646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07651d70-45dd-47fa-bf00-35babf400dbb', 'volume_name': 'volume-07651d70-45dd-47fa-bf00-35babf400dbb', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b342529-7952-4a73-92f2-cb8c5d3b668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b342529-7952-4a73-92f2-cb8c5d3b668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6cb651-ae76-4784-b888-a8bd01ea9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:30 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Volume 07651d70-45dd-47fa-bf00-35babf400dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07651d70-45dd-47fa-bf00-35babf400dbb', 'volume_size': 1}
Apr 29 08:39:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:31 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe 1073741824" returned: 0 in 1.021s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:31 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe
Apr 29 08:39:31 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:31 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" returned: 0 in 0.579s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.416s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1821102037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6832e9b9-d84e-4891-b436-d1aa1528b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ad487dc6a864cef82dd5716cf8b986e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:25Z,use_quota=True,user_id='dfbe64a5965447b7be987fb59135cc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Creating volume 6832e9b9-d84e-4891-b436-d1aa1528b9fc {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:31 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1e0dc0-ef22-410f-a5d4-3e02369e8065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a91b6e-5056-43c4-b7ec-22d1ff9db1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:31 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc 1073741824
Apr 29 08:39:31 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:31 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe (6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe): created successfully
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a91b6e-5056-43c4-b7ec-22d1ff9db1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (4282d81f-0915-4b51-8c7e-ed0ea69120fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-74fa9e20-363d-4049-ae87-60564d2c425f tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:32 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc 1073741824" returned: 0 in 0.953s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:32 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc
Apr 29 08:39:32 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc" returned: 0 in 0.765s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.725s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-84892927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07651d70-45dd-47fa-bf00-35babf400dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6992f586f6b411cb8f1fdd248371150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:31Z,use_quota=True,user_id='d14d65083d5d4212b47d0fcdc6033a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Creating volume 07651d70-45dd-47fa-bf00-35babf400dbb {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:39:33 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1b578-500a-443a-a956-e947b5cc11bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:33 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb 1073741824
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d22d98-4081-409b-a55a-dc3c2890c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:33 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:33 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Volume volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc (6832e9b9-d84e-4891-b436-d1aa1528b9fc): created successfully
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d22d98-4081-409b-a55a-dc3c2890c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Flow 'volume_create_manager' (76f79df4-4686-4b59-ae49-f088820bc18d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:33 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-85352a02-a853-4985-86dd-95967d353836 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created volume successfully.
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-6832e9b9-d84e-4891-b436-d1aa1528b9fc-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-6832e9b9-d84e-4891-b436-d1aa1528b9fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-6832e9b9-d84e-4891-b436-d1aa1528b9fc" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-6832e9b9-d84e-4891-b436-d1aa1528b9fc" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828d906-112e-4fb1-89c5-924906f775f2]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:34 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc
Apr 29 08:39:34 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:34 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb 1073741824" returned: 0 in 1.076s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:34 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb
Apr 29 08:39:34 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:35 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc" returned: 0 in 0.886s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:35 devstack sudo[89856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc
Apr 29 08:39:35 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:35 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb" returned: 0 in 0.684s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.967s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb6cb651-ae76-4784-b888-a8bd01ea9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07651d70-45dd-47fa-bf00-35babf400dbb', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f25a0a-80ac-4c53-9d1e-1f459731f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573a4fb-7a61-4f4f-8dc7-4de662ef6684]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:35 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Volume volume-07651d70-45dd-47fa-bf00-35babf400dbb (07651d70-45dd-47fa-bf00-35babf400dbb): created successfully
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f25a0a-80ac-4c53-9d1e-1f459731f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Flow 'volume_create_manager' (f3e92a9a-4ffa-47e0-8fcb-092c4b9ae209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2003d55e-2217-4884-9a9d-c24fee569ff6 tempest-VolumesTransfersV355Test-1626923475 None] Created volume successfully.
Apr 29 08:39:35 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:39:35 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6832e9b9-d84e-4891-b436-d1aa1528b9fc" returned: 0 in 0.770s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-6832e9b9-d84e-4891-b436-d1aa1528b9fc" released by "delete_volume" :: held 1.729s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['c04770dd-315a-4fd3-a44b-c8e57f07814d', 'c37b89bf-5cd2-4255-8b5a-12d8f927ed89', 'fc6771cd-c558-425a-b9fd-d618a3489434', '23a14a5b-07a4-4f45-ba24-d5c95d2871b2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack sudo[89864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:36 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "cinder-07651d70-45dd-47fa-bf00-35babf400dbb-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-07651d70-45dd-47fa-bf00-35babf400dbb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "cinder-quobyte-07651d70-45dd-47fa-bf00-35babf400dbb" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:36 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-quobyte-07651d70-45dd-47fa-bf00-35babf400dbb" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 1.147s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c1555-d209-45a9-aa9f-f0269d78468c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f78961-9036-45f4-9a14-b18bf441b056]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:36 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb
Apr 29 08:39:36 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7356b520-49e7-400c-b174-6fd782fe408e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:36 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:39:36 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe
Apr 29 08:39:37 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.900s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:37 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2ecddc55-891c-46d8-8a71-71cd34778d11 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-6832e9b9-d84e-4891-b436-d1aa1528b9fc-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:37 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb" returned: 0 in 0.925s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:37 devstack sudo[89880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb
Apr 29 08:39:37 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 1.079s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.2bebf556-c435-4f68-892f-c0f11a31a420bns_1tnx.img {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:37 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.2bebf556-c435-4f68-892f-c0f11a31a420bns_1tnx.img
Apr 29 08:39:37 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:37 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" returned: 0 in 1.104s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:38 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe
Apr 29 08:39:38 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-07651d70-45dd-47fa-bf00-35babf400dbb" returned: 0 in 0.734s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:38 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-quobyte-07651d70-45dd-47fa-bf00-35babf400dbb" released by "delete_volume" :: held 1.735s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Created reservations ['1b371db6-a52f-466a-b50a-622461aa8456', '19ae7a0b-c379-482b-a443-49deda7334ad', 'a12d14f3-357e-4ad1-b2d8-b10df7adffc6', '48ab0651-11d0-47b7-8b8a-e60b53e515e2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:38 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:38 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:38 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" returned: 0 in 0.886s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe" released by "delete_volume" :: held 2.100s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['7963cb09-d789-4d12-991a-8b8642142862', '7821e5e8-e95a-4b17-8f29-a5bad428fea7', '1fef0f11-1548-40f8-8859-98b3c8eddbc7', 'fb1bced2-dbe8-4709-a8ea-c2809b540bb3'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:39 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:39 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Flow 'volume_create_manager' (e2034c9c-4d8f-47b4-af51-8a58823a4017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdbd476-b6d8-4805-85ae-4ea5b7a68f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdbd476-b6d8-4805-85ae-4ea5b7a68f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1925311327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a3aeb277964369bbebbb4aba45b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:39Z,use_quota=True,user_id='b99a0f095ddb48e3a759ca1f916569bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822e027b-9f98-4e79-855f-0869ca822b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822e027b-9f98-4e79-855f-0869ca822b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2283d1af-3a18-4826-92d2-66ec42d5ac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2283d1af-3a18-4826-92d2-66ec42d5ac13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb', 'volume_name': 'volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cd2a99-4c2a-4161-9d1a-16851f29115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9cd2a99-4c2a-4161-9d1a-16851f29115f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec91348-0e78-48e2-83fe-ee3cc9aa6c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:39 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Volume ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb', 'volume_size': 1}
Apr 29 08:39:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-3fba61dd-976c-433b-9ab4-db5f3b2ba337-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-3fba61dd-976c-433b-9ab4-db5f3b2ba337-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:40 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.855s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Deleted volume successfully.
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-470038c9-7370-48cf-ba50-f3c5c270a258 tempest-VolumesTransfersV355Test-1879820270 None] Lock "cinder-07651d70-45dd-47fa-bf00-35babf400dbb-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-3fba61dd-976c-433b-9ab4-db5f3b2ba337" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-3fba61dd-976c-433b-9ab4-db5f3b2ba337" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03989e6c-141f-42ca-82b5-5c93dd6cd837]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:40 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.465s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35ddcd65-0183-4e12-9d27-7c87a00f0959 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-6e9cbf6f-6e81-4f1a-8305-86dbf088a1fe-delete_volume" released by "delete_volume" :: held 4.117s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:40 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337
Apr 29 08:39:40 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:43 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337" returned: 0 in 2.456s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:43 devstack sudo[89916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337
Apr 29 08:39:43 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:44 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.2bebf556-c435-4f68-892f-c0f11a31a420bns_1tnx.img" returned: 0 in 6.642s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288f979-fd71-4529-b149-41655580aa99]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:44 devstack sudo[89920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:39:44 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:44 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3fba61dd-976c-433b-9ab4-db5f3b2ba337" returned: 0 in 1.565s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-3fba61dd-976c-433b-9ab4-db5f3b2ba337" released by "delete_volume" :: held 4.138s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['220a89fa-0ec9-46bc-9cc7-24aee6a66810', '60d99851-717b-4085-a9d7-ffe73e30207b', '74c8f3af-5390-4089-936f-d68e3051b3d8', '5e4e7b4c-bb99-4a2d-bf6d-4eca1a5341a4'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:44 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:44 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-1c1bee13-5e05-473f-986d-74f2ac4ac5ad-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-1c1bee13-5e05-473f-986d-74f2ac4ac5ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[063b8f29-40e8-4038-a9f4-878a8c910227]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:45 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 1.173s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.2bebf556-c435-4f68-892f-c0f11a31a420bns_1tnx.img {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:39:45 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Converted 1024.00 MB image at 154.12 MB/s
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] 2bebf556-c435-4f68-892f-c0f11a31a420 was raw, no need to convert to raw {{(pid=84102) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 29 08:39:45 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad
Apr 29 08:39:45 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:45 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f4990581-021e-4bdf-b022-15c16daf195a tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-3fba61dd-976c-433b-9ab4-db5f3b2ba337-delete_volume" released by "delete_volume" :: held 5.442s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:46 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" returned: 0 in 0.902s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:46 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad
Apr 29 08:39:46 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:47 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-1c1bee13-5e05-473f-986d-74f2ac4ac5ad" released by "delete_volume" :: held 1.667s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['fcebc6f6-79da-4615-a8c0-0abe8bee880d', '2bf8eaff-49f3-4bbb-8795-27958e3f3837', '76de0411-1544-4005-8949-7181634e5ce4', '6c6885d3-ca09-4c6e-a394-347f00ad57ee'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:47 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:47 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f83b3-3e3d-4140-a828-0e0ec013401c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:48 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.895s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:48 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5
Apr 29 08:39:48 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-72ea4122-a7c2-4510-9739-2a25c845ce14 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-1c1bee13-5e05-473f-986d-74f2ac4ac5ad-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:49 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" returned: 0 in 1.075s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:39:49 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5
Apr 29 08:39:49 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Flow 'volume_create_manager' (c07b305b-5965-4abb-8368-fe87826b428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579072f2-e6d8-4c25-95df-88f9f14b06d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579072f2-e6d8-4c25-95df-88f9f14b06d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1724631035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8199a519-ff01-4d9c-8592-910f611fd5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7f690848134f43931225b4f9a61ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:49Z,use_quota=True,user_id='a3319cb01fc94eff8520f0b8cd896631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6d1a2e-249b-45f2-a9a2-e1bdbd4ea8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6d1a2e-249b-45f2-a9a2-e1bdbd4ea8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dfb28b-099b-4ad6-8922-4d4921ee2d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6dfb28b-099b-4ad6-8922-4d4921ee2d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8199a519-ff01-4d9c-8592-910f611fd5db', 'volume_name': 'volume-8199a519-ff01-4d9c-8592-910f611fd5db', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4a979-b4e9-450a-a8d5-a217aa3b3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4a979-b4e9-450a-a8d5-a217aa3b3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccd141a-b666-4b15-8f68-6668067961a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:39:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Volume 8199a519-ff01-4d9c-8592-910f611fd5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8199a519-ff01-4d9c-8592-910f611fd5db', 'volume_size': 1}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:49 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" returned: 0 in 0.698s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5" released by "delete_volume" :: held 1.843s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:49 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['d11c3b36-e759-4bb1-85e8-5a609a8d79e0', 'f8dfed2f-18d0-4dad-9905-3d99f62d0aca', 'd2f9bbba-29cd-4847-ba00-1d0093399115', '3b90a1f8-cfb8-406a-b314-db0498a176b7'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:50 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:50 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-ced731fb-97f2-4bff-89ef-4a5f564c9098-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-ced731fb-97f2-4bff-89ef-4a5f564c9098-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-ced731fb-97f2-4bff-89ef-4a5f564c9098" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-ced731fb-97f2-4bff-89ef-4a5f564c9098" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleting offline snapshot ced731fb-97f2-4bff-89ef-4a5f564c9098 of volume 9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] snapshot_file for this snap is: volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[632f7d37-db91-4f28-b067-4a7fc87877ec]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:50 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098
Apr 29 08:39:50 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:50 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.738s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:50 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c7c8e0ef-681e-4255-8a3d-a9a76dbc9dec tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-1f7e4a3e-9db7-48a4-9700-eeb061f0aef5-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:51 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098" returned: 0 in 0.805s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9ab9c-1720-42dd-89ba-612a51a5cad0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:51 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05
Apr 29 08:39:51 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:51 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" returned: 0 in 0.804s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:51 devstack sudo[89968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098
Apr 29 08:39:51 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:52 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:52 devstack sudo[89973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098
Apr 29 08:39:52 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:53 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05.ced731fb-97f2-4bff-89ef-4a5f564c9098" returned: 0 in 0.755s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-ced731fb-97f2-4bff-89ef-4a5f564c9098" released by "_delete_snapshot" :: held 3.338s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" released by "delete_snapshot" :: held 3.373s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:53 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['0f988d15-7d87-4450-9959-8eea196ca741', '686487af-3f96-4069-a6b2-05b597a9617c', '87313e27-4519-46fe-802a-00183907d1bb', 'a8426113-1dcc-481e-956d-f8587b8e298f'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Delete snapshot completed successfully.
Apr 29 08:39:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4f31034d-f3fd-4220-8a17-a98ee2fcc278 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-ced731fb-97f2-4bff-89ef-4a5f564c9098-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-9715ee4e-0701-46cc-97d9-c9b8a2c40d05-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-9715ee4e-0701-46cc-97d9-c9b8a2c40d05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb7702-d187-48a8-b2cc-f2318d0873b4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:39:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:54 devstack sudo[89976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05
Apr 29 08:39:54 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" returned: 0 in 0.784s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:55 devstack sudo[89981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05
Apr 29 08:39:55 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:55 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-quobyte-9715ee4e-0701-46cc-97d9-c9b8a2c40d05" released by "delete_volume" :: held 1.565s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Created reservations ['01eaf123-42e9-4ade-a5be-fef3330c18c3', '6d90aebd-0fa8-456d-8412-c73abfb2d9f3', '2c42c7e3-e9a3-4e5f-b77c-1802abadc147', '6039a7c9-5508-4ddb-b58b-30fa41ae57f3'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:39:56 devstack sudo[90021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:39:56 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:39:56 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.725s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:39:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Deleted volume successfully.
Apr 29 08:39:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b3b657ff-ef2e-4f63-af44-73b84bf33d03 tempest-CreateVolumesFromSnapshotTest-1584701999 None] Lock "cinder-9715ee4e-0701-46cc-97d9-c9b8a2c40d05-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (32d7137d-1d7b-4195-9ac1-f72900798c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062f6b63-b194-45f0-9595-7b2ae1b2ad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062f6b63-b194-45f0-9595-7b2ae1b2ad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1068420747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2449ac0-d96d-48f9-b400-af6f9df6362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:01Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d67fe-94b9-4bcb-b2af-9ab6aa41b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58d67fe-94b9-4bcb-b2af-9ab6aa41b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706bd3a1-2d80-4013-b552-b7f06cdfdfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706bd3a1-2d80-4013-b552-b7f06cdfdfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2449ac0-d96d-48f9-b400-af6f9df6362a', 'volume_name': 'volume-a2449ac0-d96d-48f9-b400-af6f9df6362a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549c5ff1-caeb-4a41-aeac-277b56106ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549c5ff1-caeb-4a41-aeac-277b56106ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d17e11-5640-4f0e-831c-57498cc14d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume a2449ac0-d96d-48f9-b400-af6f9df6362a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2449ac0-d96d-48f9-b400-af6f9df6362a', 'volume_size': 1}
Apr 29 08:40:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.333s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Uploaded volume to glance image-id: 2bebf556-c435-4f68-892f-c0f11a31a420. {{(pid=84102) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.836s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1925311327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55a3aeb277964369bbebbb4aba45b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:39Z,use_quota=True,user_id='b99a0f095ddb48e3a759ca1f916569bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Creating volume ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:06 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:06 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb 1073741824
Apr 29 08:40:06 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f6dfb1a1-898b-4b8c-9803-c7bc3745496e tempest-VolumesActionsTest-1587458550 None] Copy volume to image completed successfully.
Apr 29 08:40:07 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb 1073741824" returned: 0 in 0.856s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:07 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb
Apr 29 08:40:07 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:08 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" returned: 0 in 0.659s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.122s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1724631035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8199a519-ff01-4d9c-8592-910f611fd5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7f690848134f43931225b4f9a61ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:39:49Z,use_quota=True,user_id='a3319cb01fc94eff8520f0b8cd896631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Creating volume 8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:08 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec91348-0e78-48e2-83fe-ee3cc9aa6c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3a7df6-2b0c-4a54-9573-7ed1c1b10fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:08 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db 1073741824
Apr 29 08:40:08 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:08 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Volume volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb (ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb): created successfully
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3a7df6-2b0c-4a54-9573-7ed1c1b10fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Flow 'volume_create_manager' (e2034c9c-4d8f-47b4-af51-8a58823a4017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bb187ed0-2c55-4dda-93bf-48d77249c933 tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Created volume successfully.
Apr 29 08:40:09 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db 1073741824" returned: 0 in 0.887s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:09 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:09 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Acquiring lock "cinder-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "cinder-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Acquiring lock "cinder-quobyte-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "cinder-quobyte-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17b3fc-561b-4054-88eb-b857cdb6f48b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:10 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 0.687s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.313s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1068420747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2449ac0-d96d-48f9-b400-af6f9df6362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:01Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume a2449ac0-d96d-48f9-b400-af6f9df6362a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:10 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:10 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a 1073741824
Apr 29 08:40:10 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccd141a-b666-4b15-8f68-6668067961a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8199a519-ff01-4d9c-8592-910f611fd5db', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea758ff-f095-4b1f-83f2-729960649186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:10 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Volume volume-8199a519-ff01-4d9c-8592-910f611fd5db (8199a519-ff01-4d9c-8592-910f611fd5db): created successfully
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea758ff-f095-4b1f-83f2-729960649186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Flow 'volume_create_manager' (c07b305b-5965-4abb-8368-fe87826b428f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:10 devstack sudo[90045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb
Apr 29 08:40:10 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ef51bc89-3f89-4be2-893d-1fc7fd0e0d6d tempest-VolumesCloneTest-1482688212 None] Created volume successfully.
Apr 29 08:40:10 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" returned: 0 in 0.763s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:10 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb
Apr 29 08:40:10 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:10 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a 1073741824" returned: 0 in 0.974s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack sudo[90059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a
Apr 29 08:40:11 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Flow 'volume_create_manager' (9b761e63-f541-48ca-a54c-5a07d38725ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d65356-ce31-40c2-9dde-4c619b6c606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d65356-ce31-40c2-9dde-4c619b6c606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1072805073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475d0186-e042-4677-8da7-7ae94b43c91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7f690848134f43931225b4f9a61ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=8199a519-ff01-4d9c-8592-910f611fd5db,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:11Z,use_quota=True,user_id='a3319cb01fc94eff8520f0b8cd896631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95136e2d-0b12-4a74-84ad-20f67a8d7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95136e2d-0b12-4a74-84ad-20f67a8d7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903ca949-4d18-452e-bdbd-58c7be1e381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903ca949-4d18-452e-bdbd-58c7be1e381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '475d0186-e042-4677-8da7-7ae94b43c91e', 'volume_name': 'volume-475d0186-e042-4677-8da7-7ae94b43c91e', 'volume_size': 2, 'source_volid': '8199a519-ff01-4d9c-8592-910f611fd5db', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa485ea3-3aae-4246-997b-5f3858f85c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa485ea3-3aae-4246-997b-5f3858f85c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c8aaa-b73c-45ee-a1d2-b4296f223c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Volume 475d0186-e042-4677-8da7-7ae94b43c91e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-475d0186-e042-4677-8da7-7ae94b43c91e', 'volume_size': 2, 'source_volid': '8199a519-ff01-4d9c-8592-910f611fd5db', 'source_volstatus': 'available'}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:11 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" returned: 0 in 0.725s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "cinder-quobyte-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb" released by "delete_volume" :: held 1.545s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Created reservations ['4acf016d-8a4b-4d9c-8152-1d64ed1fb8f8', '2e93b681-a7f7-4bcd-9aeb-80babe21d693', '207f4574-abba-4e71-becf-2795affd7798', '93b3df7a-9cfe-4d80-916c-5537ee4f9ec2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:11 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:11 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a" returned: 0 in 0.649s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.595s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d17e11-5640-4f0e-831c-57498cc14d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2449ac0-d96d-48f9-b400-af6f9df6362a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8f3ed3-0147-4f0c-a22a-2a286e074e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1091466f-1158-42ff-bd0d-f7f809596070]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-a2449ac0-d96d-48f9-b400-af6f9df6362a (a2449ac0-d96d-48f9-b400-af6f9df6362a): created successfully
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8f3ed3-0147-4f0c-a22a-2a286e074e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (32d7137d-1d7b-4195-9ac1-f72900798c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:11 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a89b84fe-e1fa-4bca-b3da-13ef0c62b0f2 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:11 devstack sudo[90065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:40:11 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:12 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.631s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:12 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Deleted volume successfully.
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-36177ca8-e458-4edf-ba13-4d4624b07c5f tempest-VolumeQuotasNegativeTestJSON-1411359617 None] Lock "cinder-ce9ef086-4c9b-4cd5-9f13-ff7b74c6aefb-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:12 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.908s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea36d0a-cb43-40dd-8afc-41170c10e174]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:12 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:40:12 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (abc4fb82-04a7-4487-884a-f78d24745471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404cd6f5-a4b7-4ec3-8c3d-e86a8962e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404cd6f5-a4b7-4ec3-8c3d-e86a8962e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621953610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4b9902-e87e-4631-ab59-6ea24a14755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce8791-62f4-4f8e-b337-3dca78e2725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ce8791-62f4-4f8e-b337-3dca78e2725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4aa979-734b-4725-9eb4-86c8ab71016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4aa979-734b-4725-9eb4-86c8ab71016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4b9902-e87e-4631-ab59-6ea24a14755d', 'volume_name': 'volume-1c4b9902-e87e-4631-ab59-6ea24a14755d', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc62dfa1-000f-48d0-a4b7-0085a0dfebdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc62dfa1-000f-48d0-a4b7-0085a0dfebdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a3fb09-3fc2-4c7f-8820-f64afa426329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume 1c4b9902-e87e-4631-ab59-6ea24a14755d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4b9902-e87e-4631-ab59-6ea24a14755d', 'volume_size': 1}
Apr 29 08:40:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (a98bb8ce-5fa3-4d9d-bcd1-3f412ef372da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9909f3-08a0-4af7-a40a-ecfba5b89065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9909f3-08a0-4af7-a40a-ecfba5b89065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872429605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d5ac5c-df0a-41d6-96b6-616447091e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc775b08-e90b-43d7-b992-bc255bac892f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc775b08-e90b-43d7-b992-bc255bac892f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b8921a-a5f4-473b-b6e7-0cf2475a99da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b8921a-a5f4-473b-b6e7-0cf2475a99da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d5ac5c-df0a-41d6-96b6-616447091e38', 'volume_name': 'volume-f4d5ac5c-df0a-41d6-96b6-616447091e38', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b013a71-e30b-49f5-a0ab-9685783c89d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b013a71-e30b-49f5-a0ab-9685783c89d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aefe98f-3ef2-4b60-80f2-57857414f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:13 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume f4d5ac5c-df0a-41d6-96b6-616447091e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d5ac5c-df0a-41d6-96b6-616447091e38', 'volume_size': 1}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:13 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.930s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:13 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img
Apr 29 08:40:13 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (815eb43f-2dcc-48f0-a5c4-f0a055f67c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202fc4ac-0e28-40ac-9725-b7c9f4daf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202fc4ac-0e28-40ac-9725-b7c9f4daf24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937848022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8eaab35-e32b-424e-899c-1ee652778d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:14Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcfa90e-1694-4d5f-817b-91d1dc27e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcfa90e-1694-4d5f-817b-91d1dc27e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e4be0-c61f-44ea-a828-819cf5c4f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e4be0-c61f-44ea-a828-819cf5c4f620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8eaab35-e32b-424e-899c-1ee652778d25', 'volume_name': 'volume-f8eaab35-e32b-424e-899c-1ee652778d25', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2680cff-e501-4b3e-bcdc-032408f6fcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2680cff-e501-4b3e-bcdc-032408f6fcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027c3d9e-338b-46c1-805a-2da3f7b3046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume f8eaab35-e32b-424e-899c-1ee652778d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8eaab35-e32b-424e-899c-1ee652778d25', 'volume_size': 1}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (79ea7941-a9d1-4efb-9e1f-699fe46cb217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ffdb46-03b0-41c0-890e-766f9a9fa415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ffdb46-03b0-41c0-890e-766f9a9fa415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010855680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9b1c75-74c7-42dd-b374-f0d9e20db606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:14Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741dbd0e-f06c-4873-9745-fe025b4b927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741dbd0e-f06c-4873-9745-fe025b4b927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0841dcf-4ee6-4d64-8c00-7ae4e9d998ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0841dcf-4ee6-4d64-8c00-7ae4e9d998ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9b1c75-74c7-42dd-b374-f0d9e20db606', 'volume_name': 'volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb44253-60bd-40db-b85b-27ab6d7ec4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb44253-60bd-40db-b85b-27ab6d7ec4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e10f55d-61cc-45aa-a9aa-0ae75ac6a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume 4e9b1c75-74c7-42dd-b374-f0d9e20db606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606', 'volume_size': 1}
Apr 29 08:40:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (a86b7ac9-fef4-423c-a2c8-5ee6192ec581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387b4ac9-28a7-4c6d-a16a-205ecf1ac6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=108,cinder:UPDATE=132,cinder:INSERT=28,cinder:DELETE=9 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (387b4ac9-28a7-4c6d-a16a-205ecf1ac6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388686436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:15Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0dc1a0-ded6-4ada-be11-17eeac797bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0dc1a0-ded6-4ada-be11-17eeac797bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083f7833-0a5b-4d34-9d8f-e21f9868e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083f7833-0a5b-4d34-9d8f-e21f9868e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9', 'volume_name': 'volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a94c73-dfef-4583-8e18-5bcbecd4e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a94c73-dfef-4583-8e18-5bcbecd4e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd49928-53ea-4e5f-b9f6-86ec39f271ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9', 'volume_size': 1}
Apr 29 08:40:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:16 devstack sudo[90095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:16 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:17 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.160s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:19 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img" returned: 0 in 6.077s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:19 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee827624-f52c-4c8b-91f0-9692ea493f51]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:19 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:40:19 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:20 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.957s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:40:20 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Converted 1024.00 MB image at 168.46 MB/s
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=94,cinder:INSERT=33,cinder:UPDATE=127,cinder:DELETE=12 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] ad5b8ec8-b589-47e4-91ed-1d751c6a2826 was raw, converting to qcow2 {{(pid=84102) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6228d6de-d7d2-4767-a954-77fecbab1e8f]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:20 devstack sudo[90104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img
Apr 29 08:40:20 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:21 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img" returned: 0 in 0.769s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:21 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img
Apr 29 08:40:21 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:22 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img" returned: 1 in 0.780s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img /opt/stack/data/cinder/conversion/vol_upload_6br7s57f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:22 devstack sudo[90113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img /opt/stack/data/cinder/conversion/vol_upload_6br7s57f
Apr 29 08:40:22 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:22 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img /opt/stack/data/cinder/conversion/vol_upload_6br7s57f" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Image conversion details: src /opt/stack/data/cinder/conversion/02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375.temp_image.ad5b8ec8-b589-47e4-91ed-1d751c6a2826rlovw9gu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6br7s57f {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:40:22 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5317cc49-4303-4de9-b08d-755f363e908c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6br7s57f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:23 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6br7s57f
Apr 29 08:40:23 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:23 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6br7s57f" returned: 0 in 0.756s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.553s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Uploaded volume to glance image-id: ad5b8ec8-b589-47e4-91ed-1d751c6a2826. {{(pid=84102) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.881s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:25 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Cloning volume 8199a519-ff01-4d9c-8592-910f611fd5db to volume 475d0186-e042-4677-8da7-7ae94b43c91e
Apr 29 08:40:25 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b1585e73-61bf-4b08-8f06-b392c313fb01 tempest-VolumesActionsTest-1587458550 None] Copy volume to image completed successfully.
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Creating offline snapshot f728e66f-6733-478f-b409-540664fc7088 of volume 8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf1cf94-6942-4fe6-9d30-66f48261d1d5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:25 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:25 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 0.811s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 1G
Apr 29 08:40:26 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "cinder-quobyte-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-quobyte-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740dd1a-4246-45c1-9f73-f4a4d9d862a3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:26 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:40:26 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:27 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 1G" returned: 0 in 0.961s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8199a519-ff01-4d9c-8592-910f611fd5db -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:27 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8199a519-ff01-4d9c-8592-910f611fd5db -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:27 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:27 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.904s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:27 devstack sudo[90144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375
Apr 29 08:40:27 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:27 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8199a519-ff01-4d9c-8592-910f611fd5db -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.718s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:27 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 is being set with open permissions: ugo+rw
Apr 29 08:40:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:27 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:27 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:28 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" returned: 0 in 0.840s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-quobyte-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375" released by "delete_volume" :: held 1.800s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:28 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.786s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:28 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info
Apr 29 08:40:28 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Created reservations ['4e90f6ba-dbef-41df-97ee-92572a719faa', '572e6cdb-3fc0-4247-8066-17fb286003f4', '123f9fae-fcbd-4841-9924-c6afa92ff15e', '3ed03668-8171-4e74-b4d3-21fb63839dee'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:28 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:28 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:29 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info" returned: 0 in 0.796s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:29 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info is being set with open permissions: ugo+rw
Apr 29 08:40:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:29 devstack sudo[90155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info
Apr 29 08:40:29 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:29 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.854s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:29 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:29 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Deleted volume successfully.
Apr 29 08:40:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-277cd80f-6731-4332-9b99-f376b71fa3a9 tempest-VolumesActionsTest-1587458550 None] Lock "cinder-02325b6b-1fa5-4ddc-9b7e-bb5ae38f2375-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:30 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.info" returned: 0 in 0.748s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] snapshot: f728e66f-6733-478f-b409-540664fc7088, volume: 475d0186-e042-4677-8da7-7ae94b43c91e,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aafd7c-f960-402f-9371-5b274bf5b9ec]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:30 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:30 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:31 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.913s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8199a519-ff01-4d9c-8592-910f611fd5db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70045d7-0068-40ae-ba39-9784bd1045b8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:31 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:31 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:32 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 0.797s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:32 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:40:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:32 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e
Apr 29 08:40:32 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e" returned: 0 in 6.299s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[35edb252-5f18-4651-aa7f-afee21e7d161]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:38 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:38 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:38 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=7 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:39 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 1.129s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:40:39 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Converted 1024.00 MB image at 162.51 MB/s
Apr 29 08:40:39 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e is being set with open permissions: ugo+rw
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:39 devstack sudo[90190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e
Apr 29 08:40:39 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Flow 'volume_create_manager' (7417774f-0bd8-4357-97fb-6c6fdb6c59dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ab5372-1f15-4d58-8fea-acbd5bdab386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ab5372-1f15-4d58-8fea-acbd5bdab386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-754432839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14a7c1a-79de-4eed-b090-e5939a3dc65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04ac3bc5d444249fb5fd44f7b659a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:40Z,use_quota=True,user_id='95dd3aae59804ea68eec1dc5172e735a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80daa317-6935-4c59-8c60-2f802fc1b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80daa317-6935-4c59-8c60-2f802fc1b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c4e5a0-a61c-4726-846c-239c105c0ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.image.glance [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Creating Keystone auth plugin from conf {{(pid=84102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:40:40 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e" returned: 0 in 0.768s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" released by "_copy_volume_from_snapshot" :: held 10.021s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-quobyte-f728e66f-6733-478f-b409-540664fc7088" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-f728e66f-6733-478f-b409-540664fc7088" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Deleting offline snapshot f728e66f-6733-478f-b409-540664fc7088 of volume 8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] snapshot_file for this snap is: volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a80eb-2431-4609-92f2-c03271750891]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c4e5a0-a61c-4726-846c-239c105c0ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e14a7c1a-79de-4eed-b090-e5939a3dc65e', 'volume_name': 'volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c57860>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b16a18-d392-4ea6-801a-93ce9bb1e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b16a18-d392-4ea6-801a-93ce9bb1e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d29f08a-f55f-4c2e-8fd6-22e9b828f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Volume e14a7c1a-79de-4eed-b090-e5939a3dc65e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c57860>}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Trying to clone e14a7c1a-79de-4eed-b090-e5939a3dc65e from image 000942db-1254-4464-b86b-8409e1be6077 at location (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]). {{(pid=84102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 08:40:40 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:40 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:40:40 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a828e0e-b1e0-4bea-9091-0ca73cd898b9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:41 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD
Apr 29 08:40:41 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:41 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.879s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8199a519-ff01-4d9c-8592-910f611fd5db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae1db0-c5bd-4fdb-b4ce-d81974a7a5cd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:41 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:41 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:41 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 is fetched for user 95dd3aae59804ea68eec1dc5172e735a. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad0aa53-110b-4dbf-8b14-78ab4ec4ed32]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:41 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD
Apr 29 08:40:41 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:42 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:42 devstack sudo[90212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:42 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:42 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:42 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.805s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:42 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088
Apr 29 08:40:42 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:43 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db.f728e66f-6733-478f-b409-540664fc7088" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-f728e66f-6733-478f-b409-540664fc7088" released by "_delete_snapshot" :: held 3.304s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.382s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.701s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-621953610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c4b9902-e87e-4631-ab59-6ea24a14755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume 1c4b9902-e87e-4631-ab59-6ea24a14755d {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:43 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c8aaa-b73c-45ee-a1d2-b4296f223c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475d0186-e042-4677-8da7-7ae94b43c91e', 'volume_size': 2, 'source_volid': '8199a519-ff01-4d9c-8592-910f611fd5db', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053805c0-4305-49c5-8e79-f4be942828c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:43 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d 1073741824
Apr 29 08:40:43 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:43 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Volume volume-475d0186-e042-4677-8da7-7ae94b43c91e (475d0186-e042-4677-8da7-7ae94b43c91e): created successfully
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053805c0-4305-49c5-8e79-f4be942828c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:43 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Flow 'volume_create_manager' (9b761e63-f541-48ca-a54c-5a07d38725ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:43 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4fd74240-f0a7-4489-b7cf-2874afbbbd28 tempest-VolumesCloneTest-1482688212 None] Created volume successfully.
Apr 29 08:40:44 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d 1073741824" returned: 0 in 0.981s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:44 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d
Apr 29 08:40:44 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-475d0186-e042-4677-8da7-7ae94b43c91e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "cinder-475d0186-e042-4677-8da7-7ae94b43c91e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" acquired by "delete_volume" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbfdf59-4387-4553-b461-398a64251238]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:45 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e
Apr 29 08:40:45 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:45 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d" returned: 0 in 0.729s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.947s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1872429605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d5ac5c-df0a-41d6-96b6-616447091e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:13Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume f4d5ac5c-df0a-41d6-96b6-616447091e38 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:45 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a3fb09-3fc2-4c7f-8820-f64afa426329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4b9902-e87e-4631-ab59-6ea24a14755d', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:45 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 1073741824
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc4f07e-e4f0-451b-830e-5033940254d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:45 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:45 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-1c4b9902-e87e-4631-ab59-6ea24a14755d (1c4b9902-e87e-4631-ab59-6ea24a14755d): created successfully
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc4f07e-e4f0-451b-830e-5033940254d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (abc4fb82-04a7-4487-884a-f78d24745471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a206366d-fa96-4e14-9710-3bcb9bb03739 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:45 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e" returned: 0 in 0.931s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:45 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e
Apr 29 08:40:45 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:46 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 1073741824" returned: 0 in 0.925s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:46 devstack sudo[90246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38
Apr 29 08:40:46 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:46 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-475d0186-e042-4677-8da7-7ae94b43c91e" returned: 0 in 0.718s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-475d0186-e042-4677-8da7-7ae94b43c91e" released by "delete_volume" :: held 1.703s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Created reservations ['16acb06f-ac58-4596-9271-7cdd4dcd7265', '8bc96d61-e373-407c-a80b-146290f07b19', '2f714480-2af7-40dc-ba71-0b0ee0de8fcf', 'f65d0786-ee2c-4362-b716-7e9a95dda58f'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:46 devstack sudo[90249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:46 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-8199a519-ff01-4d9c-8592-910f611fd5db-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "cinder-8199a519-ff01-4d9c-8592-910f611fd5db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Acquiring lock "cinder-quobyte-8199a519-ff01-4d9c-8592-910f611fd5db" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-8199a519-ff01-4d9c-8592-910f611fd5db" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:47 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38" returned: 0 in 1.104s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.306s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-937848022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8eaab35-e32b-424e-899c-1ee652778d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:14Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume f8eaab35-e32b-424e-899c-1ee652778d25 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:47 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9fd16c-c982-4b91-be82-2e22006a3726]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aefe98f-3ef2-4b60-80f2-57857414f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d5ac5c-df0a-41d6-96b6-616447091e38', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:47 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 1073741824
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78dc9de-1bde-4d56-8ca6-cf4da745ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:47 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:47 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 (f4d5ac5c-df0a-41d6-96b6-616447091e38): created successfully
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78dc9de-1bde-4d56-8ca6-cf4da745ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (a98bb8ce-5fa3-4d9d-bcd1-3f412ef372da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-aa447a8c-735a-488b-b03b-4d200042fe1d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:47 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:47 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:47 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.121s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Deleted volume successfully.
Apr 29 08:40:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d3e7954c-58e6-488d-be4a-e20936842bad tempest-VolumesCloneTest-1482688212 None] Lock "cinder-475d0186-e042-4677-8da7-7ae94b43c91e-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:48 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 1.024s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:48 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db
Apr 29 08:40:48 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:48 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 1073741824" returned: 0 in 1.110s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:48 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25
Apr 29 08:40:48 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8199a519-ff01-4d9c-8592-910f611fd5db" returned: 0 in 0.687s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "cinder-quobyte-8199a519-ff01-4d9c-8592-910f611fd5db" released by "delete_volume" :: held 1.870s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Created reservations ['1273bb02-b2a6-4b3b-a81a-9d55a5dfb38e', '89a898a3-49f7-4d80-a50c-f2ddf4c31b9c', '5155d5f9-6268-42aa-9961-ea48394c3cf0', '63442028-1009-47c5-9362-50b6845a8bd0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:49 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:49 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25" returned: 0 in 0.888s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.985s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010855680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9b1c75-74c7-42dd-b374-f0d9e20db606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:14Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume 4e9b1c75-74c7-42dd-b374-f0d9e20db606 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:49 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027c3d9e-338b-46c1-805a-2da3f7b3046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8eaab35-e32b-424e-899c-1ee652778d25', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:49 devstack sudo[90273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 1073741824
Apr 29 08:40:49 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff47dd67-8c26-4f9a-8935-7dca9f7ad989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-f8eaab35-e32b-424e-899c-1ee652778d25 (f8eaab35-e32b-424e-899c-1ee652778d25): created successfully
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff47dd67-8c26-4f9a-8935-7dca9f7ad989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (815eb43f-2dcc-48f0-a5c4-f0a055f67c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7bc9f7a5-d2d2-4416-b513-63abfe50b015 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:50 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.995s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:50 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:50 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Deleted volume successfully.
Apr 29 08:40:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cdb7e435-3cff-4ceb-9418-22a5c56671ed tempest-VolumesCloneTest-1482688212 None] Lock "cinder-8199a519-ff01-4d9c-8592-910f611fd5db-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:50 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 1073741824" returned: 0 in 1.209s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:50 devstack sudo[90281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606
Apr 29 08:40:50 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:51 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.207s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1388686436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066a4ae364eb4a09aaa084ba0e043737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:15Z,use_quota=True,user_id='0d4003b0da834833bd9414649b9a3356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Creating volume bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:51 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:51 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 1073741824
Apr 29 08:40:51 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e10f55d-61cc-45aa-a9aa-0ae75ac6a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addfa8b-00ce-4eb8-ae1d-34314d49d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:51 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 (4e9b1c75-74c7-42dd-b374-f0d9e20db606): created successfully
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6addfa8b-00ce-4eb8-ae1d-34314d49d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (79ea7941-a9d1-4efb-9e1f-699fe46cb217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-18c1aba1-ce51-4831-8df4-a8cdfe9a4c8b tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:52 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 1073741824" returned: 0 in 0.977s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:52 devstack sudo[90292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9
Apr 29 08:40:52 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:53 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" returned: 0 in 0.976s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-754432839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14a7c1a-79de-4eed-b090-e5939a3dc65e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04ac3bc5d444249fb5fd44f7b659a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:40Z,use_quota=True,user_id='95dd3aae59804ea68eec1dc5172e735a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Creating volume e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:53 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:53 devstack sudo[90295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1073741824
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd49928-53ea-4e5f-b9f6-86ec39f271ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:53 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22194b-c8af-466c-a6d8-c32e8ee31c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:53 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Volume volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 (bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9): created successfully
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa22194b-c8af-466c-a6d8-c32e8ee31c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Flow 'volume_create_manager' (a86b7ac9-fef4-423c-a2c8-5ee6192ec581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ff5e3ee1-4718-4778-adfe-db2acb7187cb tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created volume successfully.
Apr 29 08:40:54 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1073741824" returned: 0 in 1.021s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:54 devstack sudo[90300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:40:54 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4cbb37-988f-4c72-988b-96529ab0ee98]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:55 devstack sudo[90302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9
Apr 29 08:40:55 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:55 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 0.784s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:55 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Attempting download of 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume e14a7c1a-79de-4eed-b090-e5939a3dc65e. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:40:56 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46789763-00c4-4ae2-97e2-9e19175db813]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_ {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:56 devstack sudo[90308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_
Apr 29 08:40:56 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:56 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" returned: 0 in 1.107s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:56 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9
Apr 29 08:40:56 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:57 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_" returned: 0 in 1.192s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_ {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:57 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9" released by "delete_volume" :: held 2.064s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:57 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_
Apr 29 08:40:57 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['20937266-12c3-448d-867e-51c76f2ccf50', 'bbb350c4-6a52-4535-8895-e488ff93574c', '09cdfb99-af24-4257-9858-7509144b951c', '5523053f-3c05-430f-99aa-34bfd57bfe8c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:57 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:40:57 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Flow 'volume_create_manager' (469bcdbe-aefe-40dc-b3e8-d3dcca8648a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64749414-484f-4084-b0c3-0eaf07a9a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64749414-484f-4084-b0c3-0eaf07a9a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1094458742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f396068-7390-471c-a5eb-aad94ee84318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02333738b1b47fe946d8b7458651a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='c0fd2c244b40431cb5968d8f3602689d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbecbc7-bb55-487b-b3a7-ab3150f9aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbecbc7-bb55-487b-b3a7-ab3150f9aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9cee83-2e49-4b21-8ba5-559400bc46f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9cee83-2e49-4b21-8ba5-559400bc46f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f396068-7390-471c-a5eb-aad94ee84318', 'volume_name': 'volume-9f396068-7390-471c-a5eb-aad94ee84318', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32017bf6-8fec-437f-b842-0d54e3dfee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32017bf6-8fec-437f-b842-0d54e3dfee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f58919d-6348-4ace-9b38-642fd6550cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:40:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Volume 9f396068-7390-471c-a5eb-aad94ee84318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f396068-7390-471c-a5eb-aad94ee84318', 'volume_size': 1}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1094458742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f396068-7390-471c-a5eb-aad94ee84318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02333738b1b47fe946d8b7458651a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:40:58Z,use_quota=True,user_id='c0fd2c244b40431cb5968d8f3602689d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Creating volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:40:57 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:40:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:57 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 1073741824
Apr 29 08:40:57 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:58 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_" returned: 1 in 0.975s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_8st9rdx_' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c8fe9-7287-401f-b54e-9aaa4a30061e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:58 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD
Apr 29 08:40:58 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:58 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.982s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:40:58 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b2f4c402-199f-40b2-a0cd-f58ad8e4be82 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-bf8ba3c9-32ff-47bb-aa1c-c05af2a1e9f9-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-4e9b1c75-74c7-42dd-b374-f0d9e20db606-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-4e9b1c75-74c7-42dd-b374-f0d9e20db606-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-4e9b1c75-74c7-42dd-b374-f0d9e20db606" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-4e9b1c75-74c7-42dd-b374-f0d9e20db606" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e14c78-635a-4e0d-89c9-86397250d5ee]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:40:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:58 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606
Apr 29 08:40:58 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:59 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 1073741824" returned: 0 in 1.307s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:59 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318
Apr 29 08:40:59 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:59 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD" returned: 0 in 1.060s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] 000942db-1254-4464-b86b-8409e1be6077 was qcow2, converting to raw {{(pid=84102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:59 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:40:59 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:40:59 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606" returned: 0 in 1.026s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:40:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:40:59 devstack sudo[90380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606
Apr 29 08:40:59 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:00 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318" returned: 0 in 0.867s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f58919d-6348-4ace-9b38-642fd6550cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f396068-7390-471c-a5eb-aad94ee84318', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b47495d-6b0b-4565-888f-af217ebd3731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Volume volume-9f396068-7390-471c-a5eb-aad94ee84318 (9f396068-7390-471c-a5eb-aad94ee84318): created successfully
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b47495d-6b0b-4565-888f-af217ebd3731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Flow 'volume_create_manager' (469bcdbe-aefe-40dc-b3e8-d3dcca8648a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-13b2b754-4ab9-405e-ba4d-b27fcafc9d8d tempest-VolumesSnapshotListTestJSON-590863013 None] Created volume successfully.
Apr 29 08:41:00 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4e9b1c75-74c7-42dd-b374-f0d9e20db606" returned: 0 in 0.763s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-4e9b1c75-74c7-42dd-b374-f0d9e20db606" released by "delete_volume" :: held 1.856s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['aa839118-7b68-4af3-a6ec-4ad74b39482b', 'b89bf3c8-39ef-4f1f-91a5-05f13b8f5a90', '0298f93f-ccc2-4942-9612-8eb3e54b5b4b', '0571a018-5557-4994-9cd3-ff9e09a9f024'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:00 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:00 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-f8eaab35-e32b-424e-899c-1ee652778d25-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-f8eaab35-e32b-424e-899c-1ee652778d25-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-f8eaab35-e32b-424e-899c-1ee652778d25" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-f8eaab35-e32b-424e-899c-1ee652778d25" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8d24b-22a2-4e0c-a318-6a788b98e9ca]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:01 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25
Apr 29 08:41:01 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Creating offline snapshot eade9307-612f-4d6d-bb92-eb4bc074fba7 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4e3da-1a25-42f5-bae2-8b98ec57c0b5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:01 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318
Apr 29 08:41:01 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:01 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.983s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:01 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0e9832b8-ad82-41c9-9549-8bfadae84556 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-4e9b1c75-74c7-42dd-b374-f0d9e20db606-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:01 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 2.698s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_avuy3wdvdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:41:01 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Converted 112.00 MB image at 41.49 MB/s
Apr 29 08:41:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:02 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1G
Apr 29 08:41:02 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:02 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25" returned: 0 in 1.203s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:02 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25
Apr 29 08:41:02 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:02 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318" returned: 0 in 1.004s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:02 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 1G
Apr 29 08:41:02 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:03 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 1G" returned: 0 in 1.170s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a024ec0-c98f-42a6-87d6-7769496ecf92]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:03 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f8eaab35-e32b-424e-899c-1ee652778d25" returned: 0 in 0.953s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-f8eaab35-e32b-424e-899c-1ee652778d25" released by "delete_volume" :: held 2.236s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['6abe8dda-f553-4ee6-bda5-cf707ef04e28', 'b72528f7-41df-4e8c-9d4d-082309db390c', '44b6e202-065f-45e4-926f-752b5de2acd5', '20b2f454-c6cd-41be-ad4a-32f6c585871a'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:03 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:03 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:03 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:03 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:03 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 1G" returned: 0 in 1.327s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:03 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:03 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:04 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 1.087s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:04 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-f4d5ac5c-df0a-41d6-96b6-616447091e38-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.020s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:04 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:04 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-f4d5ac5c-df0a-41d6-96b6-616447091e38-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-84cbfd15-a77d-4a67-9920-a1e55db4373e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-f8eaab35-e32b-424e-899c-1ee652778d25-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-f4d5ac5c-df0a-41d6-96b6-616447091e38" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-f4d5ac5c-df0a-41d6-96b6-616447091e38" acquired by "delete_volume" :: waited 0.035s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3466f9-afc9-4124-8bf9-39d19bba0e7b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:04 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38
Apr 29 08:41:04 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:04 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 1.089s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:04 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 is being set with open permissions: ugo+rw
Apr 29 08:41:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:04 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:04 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:05 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 1 in 1.197s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Downloaded image 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume e14a7c1a-79de-4eed-b090-e5939a3dc65e successfully. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 for user 95dd3aae59804ea68eec1dc5172e735a is deleted. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Marking volume e14a7c1a-79de-4eed-b090-e5939a3dc65e as bootable. {{(pid=84102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Copying metadata from image 000942db-1254-4464-b86b-8409e1be6077 to e14a7c1a-79de-4eed-b090-e5939a3dc65e. {{(pid=84102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Creating volume glance metadata for volume e14a7c1a-79de-4eed-b090-e5939a3dc65e backed by image 000942db-1254-4464-b86b-8409e1be6077 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:41:05 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d29f08a-f55f-4c2e-8fd6-22e9b828f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478c57860>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc8d121-aa75-48ec-b94e-146043dbf5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 0.854s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:05 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Volume volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e (e14a7c1a-79de-4eed-b090-e5939a3dc65e): created successfully
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc8d121-aa75-48ec-b94e-146043dbf5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Flow 'volume_create_manager' (7417774f-0bd8-4357-97fb-6c6fdb6c59dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cb4c6dcf-59e3-4f4c-a72b-0642d8890a74 tempest-VolumesExtendTest-1394054878 None] Created volume successfully.
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:05 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info
Apr 29 08:41:05 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:05 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38" returned: 0 in 1.185s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:05 devstack sudo[90451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38
Apr 29 08:41:05 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:06 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info" returned: 0 in 0.780s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:06 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info is being set with open permissions: ugo+rw
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:06 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info
Apr 29 08:41:06 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:06 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f4d5ac5c-df0a-41d6-96b6-616447091e38" returned: 0 in 0.759s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-f4d5ac5c-df0a-41d6-96b6-616447091e38" released by "delete_volume" :: held 2.012s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['5f175ec0-838c-4280-a1a8-97429204856a', '7f455f8e-f4fd-4bc9-82f6-b7839cb9ef9b', '175fd9ee-5500-4757-af60-ae18b755ba31', 'c6661dd1-1ee9-46d9-bcdf-7c95d07ec302'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:06 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:06 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-1c4b9902-e87e-4631-ab59-6ea24a14755d-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-1c4b9902-e87e-4631-ab59-6ea24a14755d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-1c4b9902-e87e-4631-ab59-6ea24a14755d" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-1c4b9902-e87e-4631-ab59-6ea24a14755d" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a2544b-2486-4f3b-aa98-e99a1b5ffd99]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:07 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d
Apr 29 08:41:07 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:07 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.info" returned: 0 in 0.783s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.978s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.994s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0330adad-62b1-4922-9e66-6fd8275dd1a7 tempest-VolumesSnapshotListTestJSON-590863013 None] Create snapshot completed successfully
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba84453-517f-451c-88a5-3eb2a3fc16ef]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:07 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.735s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c45f8942-f0c3-4c1d-b4aa-f13bc144872d tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-f4d5ac5c-df0a-41d6-96b6-616447091e38-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:07 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:07 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:08 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d" returned: 0 in 1.019s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d
Apr 29 08:41:08 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 1.105s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:08 devstack sudo[90473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:08 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:08 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1c4b9902-e87e-4631-ab59-6ea24a14755d" returned: 0 in 0.807s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-1c4b9902-e87e-4631-ab59-6ea24a14755d" released by "delete_volume" :: held 1.892s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:08 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['af3f0f68-2b22-4939-bed2-2ae973070a58', 'a5833b76-a349-411c-b702-277bbb4226d1', '3a72bb0b-b769-468a-90a6-d1472022b6d2', 'e01aca4a-ddec-44f9-8f36-e86e5fc4eb34'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:09 devstack sudo[90476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:09 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-a2449ac0-d96d-48f9-b400-af6f9df6362a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-a2449ac0-d96d-48f9-b400-af6f9df6362a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "cinder-quobyte-a2449ac0-d96d-48f9-b400-af6f9df6362a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-a2449ac0-d96d-48f9-b400-af6f9df6362a" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe656c-b71d-407c-9b18-8b3c3088c293]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:09 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 1 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 2G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:09 devstack sudo[90481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a
Apr 29 08:41:09 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e 2G" returned: 0 in 0.090s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.108s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.539s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Creating offline snapshot b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd3fd64-ee86-434e-91c8-9236bafbbc4f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8ac61c7b-6eb6-461d-b5cc-59f847a359fe tempest-VolumesExtendTest-1394054878 None] Extend volume completed successfully.
Apr 29 08:41:09 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:09 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:09 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.817s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:41:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-66f4ff90-bcef-4600-9deb-53d20cf9919e tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-1c4b9902-e87e-4631-ab59-6ea24a14755d-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-e14a7c1a-79de-4eed-b090-e5939a3dc65e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-e14a7c1a-79de-4eed-b090-e5939a3dc65e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-quobyte-e14a7c1a-79de-4eed-b090-e5939a3dc65e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-e14a7c1a-79de-4eed-b090-e5939a3dc65e" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfebf0b-80c0-45c3-b1e0-c15b0d698740]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:10 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a" returned: 0 in 0.978s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:10 devstack sudo[90495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a
Apr 29 08:41:10 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:10 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:10 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:10 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 1.053s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:10 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 1G
Apr 29 08:41:10 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:11 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 0.859s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:11 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a2449ac0-d96d-48f9-b400-af6f9df6362a" returned: 0 in 0.818s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-quobyte-a2449ac0-d96d-48f9-b400-af6f9df6362a" released by "delete_volume" :: held 1.861s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Created reservations ['33f4fb08-e4f6-4dcf-8eca-d954f4c8232d', '7ed678af-f95a-48cf-8ef7-535ade1d1f26', 'd76fbea5-c658-45ec-8c57-a5992683c877', '50a83d2c-bd22-4503-a5a8-6b4209b2ff8a'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:11 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:11 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:11 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:11 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:11 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 1G" returned: 0 in 1.021s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:11 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:11 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 1 in 0.931s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e
Apr 29 08:41:12 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.967s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:12 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Deleted volume successfully.
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-38b40f80-ddc6-481c-a170-bfeebc919d29 tempest-CreateVolumesFromSourceVolumeTest-286012515 None] Lock "cinder-a2449ac0-d96d-48f9-b400-af6f9df6362a-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:12 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.901s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 is being set with open permissions: ugo+rw
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:12 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:12 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:12 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e14a7c1a-79de-4eed-b090-e5939a3dc65e" returned: 0 in 0.782s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-e14a7c1a-79de-4eed-b090-e5939a3dc65e" released by "delete_volume" :: held 2.660s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Created reservations ['a35ec48b-6cb9-47fc-9102-6f985e6772e2', 'a0db0c1c-731e-40ef-9d78-7da7d52e82b6', 'eb454dce-7e67-49a7-a21d-08721c3560f1', '5dfb3f5f-fa6d-4a5b-8ee0-c0e399111fa2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:13 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:13 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:13 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.700s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.841s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d45e37a4-3554-4f3e-9e5d-0ab744ef055e tempest-VolumesSnapshotListTestJSON-590863013 None] Create snapshot completed successfully
Apr 29 08:41:13 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.875s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Deleted volume successfully.
Apr 29 08:41:13 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6ed30440-10db-46a9-9ee9-722ba1241ec1 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-e14a7c1a-79de-4eed-b090-e5939a3dc65e-delete_volume" released by "delete_volume" :: held 3.885s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Flow 'volume_create_manager' (ee728dae-4420-4f3a-9aec-967fe2f9c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295870b4-8d14-45a4-9c4d-c2b872ae448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295870b4-8d14-45a4-9c4d-c2b872ae448f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-224892345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617b1bcd-6e14-45a5-b8bf-2fc18e41dce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04ac3bc5d444249fb5fd44f7b659a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:14Z,use_quota=True,user_id='95dd3aae59804ea68eec1dc5172e735a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8a4dc3-24af-421b-91e9-2b5c4eeb69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8a4dc3-24af-421b-91e9-2b5c4eeb69d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed78c4a-0033-4009-a6f9-949479033b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed78c4a-0033-4009-a6f9-949479033b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617b1bcd-6e14-45a5-b8bf-2fc18e41dce4', 'volume_name': 'volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e29976-7909-41d2-b600-3db74224e6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e29976-7909-41d2-b600-3db74224e6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25055261-4052-4a07-9ab2-e01cfa82c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Volume 617b1bcd-6e14-45a5-b8bf-2fc18e41dce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4', 'volume_size': 1}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-224892345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617b1bcd-6e14-45a5-b8bf-2fc18e41dce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a04ac3bc5d444249fb5fd44f7b659a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:14Z,use_quota=True,user_id='95dd3aae59804ea68eec1dc5172e735a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Creating volume 617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:14 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:14 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 1073741824
Apr 29 08:41:14 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:15 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 1073741824" returned: 0 in 0.967s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:15 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:15 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (fa710533-0513-418c-ad30-4cdac20d6a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bdfc20-2acd-4561-b029-9408a59ca098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bdfc20-2acd-4561-b029-9408a59ca098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491358335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8409c57b-e6b9-4fd4-8280-0fc50d7dceef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:15Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f38044-4741-40b3-b05a-8cc5b5c44215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f38044-4741-40b3-b05a-8cc5b5c44215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89835856-a20d-4a41-89f8-c08a7e8135e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89835856-a20d-4a41-89f8-c08a7e8135e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8409c57b-e6b9-4fd4-8280-0fc50d7dceef', 'volume_name': 'volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a229cf-31c4-44e3-a891-8544def9f2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a229cf-31c4-44e3-a891-8544def9f2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8646250f-bdfb-4223-bb3b-08abe76c2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Volume 8409c57b-e6b9-4fd4-8280-0fc50d7dceef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef', 'volume_size': 1}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:15 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.363s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Creating offline snapshot 04d21c47-715c-4ce6-a8f3-34becb96cd52 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25055261-4052-4a07-9ab2-e01cfa82c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e9260-4def-4c8c-960e-f74e38ba077d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc5e68-7c79-4cd3-b28d-c2406a67309a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Volume volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 (617b1bcd-6e14-45a5-b8bf-2fc18e41dce4): created successfully
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133e9260-4def-4c8c-960e-f74e38ba077d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Flow 'volume_create_manager' (ee728dae-4420-4f3a-9aec-967fe2f9c449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-76b3e4c8-0cee-4d5d-b6da-df15b7a5ee71 tempest-VolumesExtendTest-1394054878 None] Created volume successfully.
Apr 29 08:41:16 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:16 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:16 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:16 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.939s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:16 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 1G
Apr 29 08:41:16 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:17 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.698s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:17 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 1G" returned: 0 in 1.007s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:17 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52
Apr 29 08:41:17 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:18 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52" returned: 0 in 0.673s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:18 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 is being set with open permissions: ugo+rw
Apr 29 08:41:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:18 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52
Apr 29 08:41:18 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52" returned: 0 in 0.649s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.383s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.934s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491358335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8409c57b-e6b9-4fd4-8280-0fc50d7dceef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:15Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Creating volume 8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:19 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:19 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef 1073741824
Apr 29 08:41:19 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-41fd01a1-02b7-4e36-b2f7-bca6c9716259 tempest-VolumesSnapshotListTestJSON-590863013 None] Create snapshot completed successfully
Apr 29 08:41:20 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef 1073741824" returned: 0 in 0.858s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:20 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-04d21c47-715c-4ce6-a8f3-34becb96cd52-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-04d21c47-715c-4ce6-a8f3-34becb96cd52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-04d21c47-715c-4ce6-a8f3-34becb96cd52" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-04d21c47-715c-4ce6-a8f3-34becb96cd52" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Deleting offline snapshot 04d21c47-715c-4ce6-a8f3-34becb96cd52 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] snapshot_file for this snap is: volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d1b28a-5fbc-4334-9509-d896410f32ca]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52
Apr 29 08:41:20 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:20 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.683s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.304s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8646250f-bdfb-4223-bb3b-08abe76c2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804c2027-1419-4d4b-8c0b-4c32d83faf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Creating offline snapshot 2cc236d6-b956-49cd-b150-9dd347b74f1a of volume 617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:20 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Volume volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef (8409c57b-e6b9-4fd4-8280-0fc50d7dceef): created successfully
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804c2027-1419-4d4b-8c0b-4c32d83faf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (fa710533-0513-418c-ad30-4cdac20d6a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[394f6be9-d293-430c-8e66-efc267ad1535]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:20 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e76537d7-9ced-4801-91bf-d474f2337758 tempest-VolumeDependencyTests-1164748449 None] Created volume successfully.
Apr 29 08:41:21 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:21 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:21 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52" returned: 0 in 0.791s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcf08a2-83f0-434e-9130-1f0fe89443c3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:21 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:21 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:21 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 0.828s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:21 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a 1G
Apr 29 08:41:21 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:22 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 1.033s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:22 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52
Apr 29 08:41:22 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a 1G" returned: 0 in 1.358s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:23 devstack sudo[90686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a
Apr 29 08:41:23 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52" returned: 0 in 1.093s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:23 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52
Apr 29 08:41:23 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:23 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a" returned: 0 in 0.851s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:23 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a is being set with open permissions: ugo+rw
Apr 29 08:41:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:24 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a
Apr 29 08:41:24 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:24 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.04d21c47-715c-4ce6-a8f3-34becb96cd52" returned: 0 in 0.793s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-04d21c47-715c-4ce6-a8f3-34becb96cd52" released by "_delete_snapshot" :: held 3.839s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" released by "delete_snapshot" :: held 3.864s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Created reservations ['f668d317-adf4-427f-b3bf-736dc46e9134', 'b90cbf56-a4f2-4ed3-bf09-8104f5de4ead', 'a01f0ca4-3b0e-4784-a626-c40548c8c6db', 'b797d017-e3cc-4ca9-9736-85f5f41fd65d'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Delete snapshot completed successfully.
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d6db593-6580-41a1-8799-502a24eb35d7 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-04d21c47-715c-4ce6-a8f3-34becb96cd52-delete_snapshot" released by "delete_snapshot" :: held 4.067s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:24 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a" returned: 0 in 0.784s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:24 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info
Apr 29 08:41:24 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Deleting offline snapshot b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] snapshot_file for this snap is: volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6abfcb-2436-45d8-8ff8-368d7319502a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:25 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:25 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:25 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info" returned: 0 in 0.738s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:25 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info is being set with open permissions: ugo+rw
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:25 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info
Apr 29 08:41:25 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:25 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.888s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9543ef4d-a153-4ce5-a232-5c3455014783]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:26 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:26 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:26 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.info" returned: 0 in 0.866s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.627s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.630s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Creating offline snapshot e14e5c5a-040b-4e75-b05c-bab28cadf5e1 of volume 8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa3c86-7696-41b0-a8bb-2f325e2792cc]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:26 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8660aab5-5725-47d4-ab4f-4aee9690c56e tempest-VolumesExtendTest-1394054878 None] Create snapshot completed successfully
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (d6e3ec7a-3eda-40cc-892f-bf67b7bf608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f7be63-cc14-41b8-b895-35f3cdf776c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f7be63-cc14-41b8-b895-35f3cdf776c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-517106879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a432653-ecb6-49f2-9943-fb82ec28781f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:27Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62725f8-03d0-47ad-83c4-ee184fdee4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62725f8-03d0-47ad-83c4-ee184fdee4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cd9825-1539-41fd-beb2-25b2c0c37cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cd9825-1539-41fd-beb2-25b2c0c37cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a432653-ecb6-49f2-9943-fb82ec28781f', 'volume_name': 'volume-7a432653-ecb6-49f2-9943-fb82ec28781f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd785a7-5d0a-45f2-9448-78ea801da5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd785a7-5d0a-45f2-9448-78ea801da5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:26 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:26 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f82a6d9-0bc7-429d-8a09-fc7dc1825334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Volume 7a432653-ecb6-49f2-9943-fb82ec28781f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a432653-ecb6-49f2-9943-fb82ec28781f', 'volume_size': 1}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:26 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 1.023s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:26 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:26 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:27 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:27 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 1G
Apr 29 08:41:27 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:27 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.817s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:27 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2
Apr 29 08:41:27 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:28 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 1G" returned: 0 in 0.822s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:28 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:28 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:28 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2" released by "_delete_snapshot" :: held 3.609s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" released by "delete_snapshot" :: held 3.639s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Created reservations ['252b7155-4b72-4455-81e8-508dd1015aff', 'fdd7ad2c-1ff8-4ab6-876f-9516c0712f1b', '6b6c07a3-1458-4b19-8b63-22fa769fa289', '43c58236-7774-4434-98a1-1a76b48804d9'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:28 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Delete snapshot completed successfully.
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a1558fb9-82ac-41dd-89b4-66a642177d61 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-b4b238e2-bcea-430e-b5f0-1a3a3141ddd2-delete_snapshot" released by "delete_snapshot" :: held 3.832s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:28 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 0.744s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:28 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 is being set with open permissions: ugo+rw
Apr 29 08:41:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:29 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:29 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-eade9307-612f-4d6d-bb92-eb4bc074fba7-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-eade9307-612f-4d6d-bb92-eb4bc074fba7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-eade9307-612f-4d6d-bb92-eb4bc074fba7" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-eade9307-612f-4d6d-bb92-eb4bc074fba7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Deleting offline snapshot eade9307-612f-4d6d-bb92-eb4bc074fba7 of volume 9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] snapshot_file for this snap is: volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e66d0e-ed5b-4588-b791-593a446afc31]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:29 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:29 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:29 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 0.625s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:29 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info
Apr 29 08:41:29 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 0.778s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f396068-7390-471c-a5eb-aad94ee84318(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6f0e6-774b-4399-9cb6-5b693f21310f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:30 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318
Apr 29 08:41:30 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info" returned: 0 in 0.647s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info is being set with open permissions: ugo+rw
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:30 devstack sudo[90757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info
Apr 29 08:41:30 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318" returned: 0 in 0.823s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:30 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:30 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:30 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.info" returned: 0 in 0.628s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.470s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.261s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-517106879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a432653-ecb6-49f2-9943-fb82ec28781f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:27Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Creating volume 7a432653-ecb6-49f2-9943-fb82ec28781f {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:30 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:31 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f 1073741824
Apr 29 08:41:31 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4e3ab9d0-0d88-4bf3-92c6-220990e7e0a8 tempest-VolumeDependencyTests-1164748449 None] Create snapshot completed successfully
Apr 29 08:41:31 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 0.844s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:31 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7
Apr 29 08:41:31 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:32 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f 1073741824" returned: 0 in 1.252s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (232dacea-1f0b-42a1-a26c-305794255e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d687499-5094-4e53-94b3-aaec8279ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d687499-5094-4e53-94b3-aaec8279ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769276221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5810ec-ea57-4867-b424-03988b79ffef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e14e5c5a-040b-4e75-b05c-bab28cadf5e1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:32Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd2c123-dd13-491e-97dd-40dbfa4c8c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd2c123-dd13-491e-97dd-40dbfa4c8c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb99124-9539-4248-bc05-ee07cce759c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb99124-9539-4248-bc05-ee07cce759c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d5810ec-ea57-4867-b424-03988b79ffef', 'volume_name': 'volume-6d5810ec-ea57-4867-b424-03988b79ffef', 'volume_size': 1, 'snapshot_id': 'e14e5c5a-040b-4e75-b05c-bab28cadf5e1'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1393bebf-3dc8-4482-b605-e18e655246d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1393bebf-3dc8-4482-b605-e18e655246d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8e3a7e-6e0c-4781-b72d-6aae33d5ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:32 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Volume 6d5810ec-ea57-4867-b424-03988b79ffef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d5810ec-ea57-4867-b424-03988b79ffef', 'volume_size': 1, 'snapshot_id': 'e14e5c5a-040b-4e75-b05c-bab28cadf5e1'}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:32 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f
Apr 29 08:41:32 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:32 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318.eade9307-612f-4d6d-bb92-eb4bc074fba7" returned: 0 in 0.782s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-eade9307-612f-4d6d-bb92-eb4bc074fba7" released by "_delete_snapshot" :: held 3.354s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" released by "delete_snapshot" :: held 3.385s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Created reservations ['489c96b7-9828-4c99-b0a4-9d55625e18c1', '5fc2e3b9-5761-4005-a99c-8c893d23d769', 'eefea06f-1071-44fe-90d8-3254e6950c29', 'f873de80-4d9b-4a2a-befe-dd55b4a51ae9'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Delete snapshot completed successfully.
Apr 29 08:41:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-063ccadb-9735-41d4-bbd9-7a752aee42c4 tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-eade9307-612f-4d6d-bb92-eb4bc074fba7-delete_snapshot" released by "delete_snapshot" :: held 3.599s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:33 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f" returned: 0 in 0.669s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.826s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f82a6d9-0bc7-429d-8a09-fc7dc1825334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a432653-ecb6-49f2-9943-fb82ec28781f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896fb8bc-90aa-4bc4-9a83-b69b77608cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78d5db-4eca-4457-be0d-a1d6bfcf984d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:33 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Volume volume-7a432653-ecb6-49f2-9943-fb82ec28781f (7a432653-ecb6-49f2-9943-fb82ec28781f): created successfully
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896fb8bc-90aa-4bc4-9a83-b69b77608cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (d6e3ec7a-3eda-40cc-892f-bf67b7bf608a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:33 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-867a2c91-8e3a-4b21-8d77-deb6fa0ce43d tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:41:33 devstack sudo[90783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:33 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-9f396068-7390-471c-a5eb-aad94ee84318-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-9f396068-7390-471c-a5eb-aad94ee84318-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e995ed3-9fce-4c6c-b237-c8f856f5f18e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:33 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318
Apr 29 08:41:33 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:34 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 1.005s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a 2G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6eb94795-61cb-49a5-8d5a-18d8b8607ef7 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f" by "attach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6eb94795-61cb-49a5-8d5a-18d8b8607ef7 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f" acquired by "attach_volume" :: waited 0.034s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6eb94795-61cb-49a5-8d5a-18d8b8607ef7 tempest-VolumesActionsTest-1833347450 None] Attaching volume 7a432653-ecb6-49f2-9943-fb82ec28781f to instance cd1cb762-255c-41b1-8d5b-7a9bc3f73191 at mountpoint /dev/vdb on host None.
Apr 29 08:41:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6eb94795-61cb-49a5-8d5a-18d8b8607ef7 tempest-VolumesActionsTest-1833347450 None] Attach volume completed successfully.
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6eb94795-61cb-49a5-8d5a-18d8b8607ef7 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f" released by "attach_volume" :: held 0.149s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a 2G" returned: 0 in 0.238s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.302s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.990s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-6d5810ec-ea57-4867-b424-03988b79ffef" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-6d5810ec-ea57-4867-b424-03988b79ffef" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Creating volume 6d5810ec-ea57-4867-b424-03988b79ffef from snapshot e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ef2b0dd9-4c7b-4688-8799-4f68d0464af4 tempest-VolumesExtendTest-1394054878 None] Extend volume completed successfully.
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] snapshot: e14e5c5a-040b-4e75-b05c-bab28cadf5e1, volume: 6d5810ec-ea57-4867-b424-03988b79ffef,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f97831-69a3-49ba-a1f9-3a5896ef9266]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:34 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:34 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:34 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318" returned: 0 in 1.008s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:34 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318
Apr 29 08:41:34 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-2cc236d6-b956-49cd-b150-9dd347b74f1a-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-2cc236d6-b956-49cd-b150-9dd347b74f1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-quobyte-2cc236d6-b956-49cd-b150-9dd347b74f1a" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-2cc236d6-b956-49cd-b150-9dd347b74f1a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Deleting offline snapshot 2cc236d6-b956-49cd-b150-9dd347b74f1a of volume 617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] snapshot_file for this snap is: volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d136535-9627-49cc-ad52-d69e242c6759]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:35 devstack sudo[90800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a
Apr 29 08:41:35 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Terminate volume connection completed successfully.
Apr 29 08:41:35 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 1.041s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a75f977-7c3a-4529-adc0-8fa449b922f1]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:35 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9f396068-7390-471c-a5eb-aad94ee84318" returned: 0 in 0.963s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-quobyte-9f396068-7390-471c-a5eb-aad94ee84318" released by "delete_volume" :: held 2.040s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:35 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:35 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Created reservations ['424a7e6e-963f-43a6-8268-24a512612a0f', '564c88a9-cdd5-4eb5-b53e-af872a163185', '2e3cd080-3ef7-4acc-812f-57ec4fac193a', 'e0bc0a35-77a4-4727-ad3a-4fbeb5d37c51'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:35 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:35 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" by "detach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Detaching volume 7a432653-ecb6-49f2-9943-fb82ec28781f from instance cd1cb762-255c-41b1-8d5b-7a9bc3f73191.
Apr 29 08:41:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Detach volume completed successfully.
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c791780b-161b-46d0-8bfb-7cf334392fbf tempest-VolumesActionsTest-2132793594 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" released by "detach_volume" :: held 0.164s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:36 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a" returned: 0 in 1.063s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba91398-140e-4ca9-81af-bb5510c73fca]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:36 devstack sudo[90828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:36 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:36 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.971s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:36 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef
Apr 29 08:41:36 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24c4cd07-72dd-4b45-b811-e3943dc6fcb8 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" by "detach_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24c4cd07-72dd-4b45-b811-e3943dc6fcb8 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-24c4cd07-72dd-4b45-b811-e3943dc6fcb8 tempest-VolumesActionsTest-1833347450 None] Volume detach called, but volume not attached.
Apr 29 08:41:36 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.920s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-24c4cd07-72dd-4b45-b811-e3943dc6fcb8 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Deleted volume successfully.
Apr 29 08:41:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-febe7f4c-5ded-47fa-bdb5-d53a0cc1190d tempest-VolumesSnapshotListTestJSON-590863013 None] Lock "cinder-9f396068-7390-471c-a5eb-aad94ee84318-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:37 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 0.897s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:37 devstack sudo[90840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a
Apr 29 08:41:37 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-quobyte-7a432653-ecb6-49f2-9943-fb82ec28781f" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-quobyte-7a432653-ecb6-49f2-9943-fb82ec28781f" acquired by "delete_volume" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f12465-2f56-47f7-ac21-6265adf60c26]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:37 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f
Apr 29 08:41:37 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:38 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a" returned: 0 in 1.658s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:38 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f" returned: 0 in 1.358s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:38 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a
Apr 29 08:41:38 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:39 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f
Apr 29 08:41:39 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4.2cc236d6-b956-49cd-b150-9dd347b74f1a" returned: 0 in 1.060s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:39 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:39 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=111,cinder:UPDATE=149,cinder:DELETE=10,cinder:INSERT=33 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:41:39 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=142,cinder:SELECT=126,cinder:INSERT=48,cinder:DELETE=16 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:41:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-2cc236d6-b956-49cd-b150-9dd347b74f1a" released by "_delete_snapshot" :: held 4.980s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" released by "delete_snapshot" :: held 5.031s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:40 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Created reservations ['3e36cc0a-4bee-46d6-ac5a-600a8e915834', '7824e23c-dabf-4f66-a425-7e3b1a417a50', '00d5e6c4-c1d6-45dc-a5e5-29c437135408', 'b0a32ca1-ba20-4a52-b581-2f17f3279827'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Delete snapshot completed successfully.
Apr 29 08:41:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-44e4cc93-a4fd-402f-8d50-7eb95c9addda tempest-VolumesExtendTest-1394054878 None] Lock "cinder-2cc236d6-b956-49cd-b150-9dd347b74f1a-delete_snapshot" released by "delete_snapshot" :: held 5.567s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:41 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7a432653-ecb6-49f2-9943-fb82ec28781f" returned: 0 in 2.726s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-quobyte-7a432653-ecb6-49f2-9943-fb82ec28781f" released by "delete_volume" :: held 4.189s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Created reservations ['0edf3f31-ca33-43b3-add6-1bb9bf115360', 'b726d16d-a3e0-431f-b173-9bd0574e698d', 'ab6b0bd7-28ae-4398-ae90-41c109c8f80a', '95b77434-f9e7-4de3-904d-9b21d51fd13f'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" acquired by "delete_volume" :: waited 0.097s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a90951c-3fdf-4558-98b0-1d6f19eae4d5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:42 devstack sudo[90871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:42 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:42 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:42 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef" returned: 0 in 7.320s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[193266a2-2eb4-4a4c-94a7-634db0b6b9db]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:44 devstack sudo[90875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:44 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:44 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.867s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Deleted volume successfully.
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1009398b-afb9-44ee-bede-7be6e5b9eb42 tempest-VolumesActionsTest-1833347450 None] Lock "cinder-7a432653-ecb6-49f2-9943-fb82ec28781f-delete_volume" released by "delete_volume" :: held 7.022s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:44 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 2.275s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:44 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4
Apr 29 08:41:44 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Flow 'volume_create_manager' (84f776f2-4a9e-49d4-9d85-7d224d4b60c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8ad32-9d92-4462-8a7d-ed952bc959e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be8ad32-9d92-4462-8a7d-ed952bc959e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe310bc-d833-4e47-8cce-cc8aedf3a3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaf57d046ca44838638a61d09bd731d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:45Z,use_quota=True,user_id='2ce6f14f579140e3a2f4aaebc37de1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae0587a-9fec-41f3-a7e0-6a97a66e9000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae0587a-9fec-41f3-a7e0-6a97a66e9000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52492751-085a-4b13-b535-c5381ae22d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52492751-085a-4b13-b535-c5381ae22d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe310bc-d833-4e47-8cce-cc8aedf3a3c3', 'volume_name': 'volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba59a001-1b8b-4394-a335-2f54a31b90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba59a001-1b8b-4394-a335-2f54a31b90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558aedce-10b4-4be8-b436-d8f840add9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:44 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Volume 4fe310bc-d833-4e47-8cce-cc8aedf3a3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3', 'volume_size': 1}
Apr 29 08:41:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:45 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 1.627s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:41:45 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Converted 1024.00 MB image at 139.84 MB/s
Apr 29 08:41:45 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef is being set with open permissions: ugo+rw
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:45 devstack sudo[90931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef
Apr 29 08:41:45 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:45 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" returned: 0 in 1.029s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-quobyte-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4" released by "delete_volume" :: held 3.494s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Created reservations ['8ee273cb-3aa1-483d-a31b-56fb4bdcc1e0', '16d91409-5baa-4e23-84a8-6f85ba6e81ae', '2b6b1734-15bd-48e1-bd84-3ab889a56e4c', '554a4399-beea-4170-ab41-0b62955be0a5'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:45 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:45 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:46 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef" returned: 0 in 0.852s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" released by "_copy_volume_from_snapshot" :: held 11.933s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-6d5810ec-ea57-4867-b424-03988b79ffef" released by "_create_volume_from_snapshot" :: held 11.971s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.017s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.489s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe310bc-d833-4e47-8cce-cc8aedf3a3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaf57d046ca44838638a61d09bd731d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:45Z,use_quota=True,user_id='2ce6f14f579140e3a2f4aaebc37de1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Creating volume 4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:46 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:46 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 1073741824
Apr 29 08:41:46 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8e3a7e-6e0c-4781-b72d-6aae33d5ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5810ec-ea57-4867-b424-03988b79ffef', 'volume_size': 1, 'snapshot_id': 'e14e5c5a-040b-4e75-b05c-bab28cadf5e1'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e18e29-f802-4def-b12b-0b432dcdcd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:46 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Volume volume-6d5810ec-ea57-4867-b424-03988b79ffef (6d5810ec-ea57-4867-b424-03988b79ffef): created successfully
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e18e29-f802-4def-b12b-0b432dcdcd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (232dacea-1f0b-42a1-a26c-305794255e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3ada53b2-66bb-4c33-83f5-89ed898629e1 tempest-VolumeDependencyTests-1164748449 None] Created volume successfully.
Apr 29 08:41:46 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.759s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Deleted volume successfully.
Apr 29 08:41:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-050281cc-31c2-4ba7-a2e6-485a2e954247 tempest-VolumesExtendTest-1394054878 None] Lock "cinder-617b1bcd-6e14-45a5-b8bf-2fc18e41dce4-delete_volume" released by "delete_volume" :: held 4.783s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Deleting offline snapshot e14e5c5a-040b-4e75-b05c-bab28cadf5e1 of volume 8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] snapshot_file for this snap is: volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f3687-c50a-41f1-b181-4d5b8238cfba]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:47 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:47 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:47 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 1073741824" returned: 0 in 1.147s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:47 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3
Apr 29 08:41:47 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:48 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 1.036s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ac2ab5-2c86-4961-b8bb-df318deda1d3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:48 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" returned: 0 in 0.790s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558aedce-10b4-4be8-b436-d8f840add9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554387c-4389-4a5a-b74b-eb5290dfc79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:48 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Volume volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 (4fe310bc-d833-4e47-8cce-cc8aedf3a3c3): created successfully
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554387c-4389-4a5a-b74b-eb5290dfc79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:48 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Flow 'volume_create_manager' (84f776f2-4a9e-49d4-9d85-7d224d4b60c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-835ae5cd-4839-41fc-ab4c-fa5fcc11f6e6 tempest-CinderUnicodeTest-1096836662 None] Created volume successfully.
Apr 29 08:41:48 devstack sudo[90954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:48 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:49 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.850s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:49 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:49 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Flow 'volume_create_manager' (22ddf87d-a00b-45ef-853c-3494a158d15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfca93b-6aad-44b7-91be-cee4441a41c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cfca93b-6aad-44b7-91be-cee4441a41c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1874629235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaf57d046ca44838638a61d09bd731d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:49Z,use_quota=True,user_id='2ce6f14f579140e3a2f4aaebc37de1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af2cf0b-a319-4394-bcd4-811be876b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af2cf0b-a319-4394-bcd4-811be876b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfc1060-aa66-4d7b-9771-2bab15e01342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfc1060-aa66-4d7b-9771-2bab15e01342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c', 'volume_name': 'volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cbcede-e381-475d-ba3d-ad353f878d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cbcede-e381-475d-ba3d-ad353f878d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02ea3c4-1f64-4df8-8f12-8b6bd454d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Volume f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c', 'volume_size': 1}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1874629235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaf57d046ca44838638a61d09bd731d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:49Z,use_quota=True,user_id='2ce6f14f579140e3a2f4aaebc37de1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Creating volume f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:49 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:49 devstack sudo[90963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c 1073741824
Apr 29 08:41:49 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:50 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 0.919s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:50 devstack sudo[90968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1
Apr 29 08:41:50 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (92ff3cb2-1777-4492-914f-f3dcfa6cd2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60716d9-171e-48e5-8121-7f3ad3955cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60716d9-171e-48e5-8121-7f3ad3955cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-784175076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b646416-737b-4e34-bfcd-29aa3b5913af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:50Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f550d8-fb21-423a-9c43-78f1812b30bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f550d8-fb21-423a-9c43-78f1812b30bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bfe8b8-bb81-4f3c-b6ec-2624db2ccd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bfe8b8-bb81-4f3c-b6ec-2624db2ccd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b646416-737b-4e34-bfcd-29aa3b5913af', 'volume_name': 'volume-6b646416-737b-4e34-bfcd-29aa3b5913af', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dd6a22-4f76-4921-9deb-ec32b3f19721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dd6a22-4f76-4921-9deb-ec32b3f19721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b645a8-5dbf-41a8-9475-6f03071cb290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:50 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Volume 6b646416-737b-4e34-bfcd-29aa3b5913af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b646416-737b-4e34-bfcd-29aa3b5913af', 'volume_size': 1}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:50 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c 1073741824" returned: 0 in 1.037s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:50 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c
Apr 29 08:41:50 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:50 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef.e14e5c5a-040b-4e75-b05c-bab28cadf5e1" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-e14e5c5a-040b-4e75-b05c-bab28cadf5e1" released by "_delete_snapshot" :: held 3.699s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" released by "delete_snapshot" :: held 3.732s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Created reservations ['af6a326d-0079-4f23-b2d4-e37d0dfee988', 'ea052f46-ef29-4069-bcf0-5fcb84ba84d6', 'b53f2a53-ecc5-446e-939b-b13093e5b38e', 'bb8e640f-863a-4688-b65c-a9b0fe3172d4'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Delete snapshot completed successfully.
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-435a3995-1ff8-4e2b-9377-2775851c50d3 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-e14e5c5a-040b-4e75-b05c-bab28cadf5e1-delete_snapshot" released by "delete_snapshot" :: held 4.032s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-8409c57b-e6b9-4fd4-8280-0fc50d7dceef-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:51 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" returned: 0 in 0.764s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-784175076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b646416-737b-4e34-bfcd-29aa3b5913af,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:50Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Creating volume 6b646416-737b-4e34-bfcd-29aa3b5913af {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:51 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-8409c57b-e6b9-4fd4-8280-0fc50d7dceef-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:51 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af 1073741824
Apr 29 08:41:51 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02ea3c4-1f64-4df8-8f12-8b6bd454d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90840a52-461f-4449-8666-28330bd1dbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Volume volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c (f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c): created successfully
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90840a52-461f-4449-8666-28330bd1dbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Flow 'volume_create_manager' (22ddf87d-a00b-45ef-853c-3494a158d15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (ba2183f0-e67d-4974-831a-7199cb765753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadfcdca-45c0-445a-a46d-9f1e952bfa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f77273b6-7ce5-4d83-9d44-bc6e2765edb0 tempest-CinderUnicodeTest-1096836662 None] Created volume successfully.
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadfcdca-45c0-445a-a46d-9f1e952bfa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827107324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4752910-1a6b-4501-a11a-4a60af1fe110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:51Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39aa0e-3fd9-4f82-9e45-928b3ca8e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39aa0e-3fd9-4f82-9e45-928b3ca8e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04b553e-b835-48d2-9820-8b9d9176a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04b553e-b835-48d2-9820-8b9d9176a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4752910-1a6b-4501-a11a-4a60af1fe110', 'volume_name': 'volume-c4752910-1a6b-4501-a11a-4a60af1fe110', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6664f17c-cadf-4b9f-ac7a-976942e1b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6664f17c-cadf-4b9f-ac7a-976942e1b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9086a613-fcdf-42b3-896f-2f89b8c36070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:51 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Volume c4752910-1a6b-4501-a11a-4a60af1fe110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4752910-1a6b-4501-a11a-4a60af1fe110', 'volume_size': 1}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26449499-7615-4c3d-8819-7f34cc0102e5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:51 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:51 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:52 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af 1073741824" returned: 0 in 0.878s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:52 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af
Apr 29 08:41:52 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:52 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.896s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:52 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef
Apr 29 08:41:52 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:53 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af" returned: 0 in 0.709s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1827107324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4752910-1a6b-4501-a11a-4a60af1fe110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:51Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Creating volume c4752910-1a6b-4501-a11a-4a60af1fe110 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:53 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:53 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 1073741824
Apr 29 08:41:53 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b645a8-5dbf-41a8-9475-6f03071cb290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b646416-737b-4e34-bfcd-29aa3b5913af', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99f9375-eecc-4741-a9b3-9ffe081f66e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:53 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Volume volume-6b646416-737b-4e34-bfcd-29aa3b5913af (6b646416-737b-4e34-bfcd-29aa3b5913af): created successfully
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99f9375-eecc-4741-a9b3-9ffe081f66e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (92ff3cb2-1777-4492-914f-f3dcfa6cd2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-efe83fc1-637b-4354-b9af-1d29f3c46b09 tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:41:53 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" returned: 0 in 0.758s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-8409c57b-e6b9-4fd4-8280-0fc50d7dceef" released by "delete_volume" :: held 1.724s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Created reservations ['2a3baaf9-afe5-4b40-b3d4-53b3976ca8e5', 'eab71aa1-3f98-45ee-8c64-8be63d3da467', '43e94d59-8042-4c90-a6b2-29335144e40e', 'c25fadfd-6b9f-42c5-b217-17ad2d8f9948'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:53 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:53 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:54 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 1073741824" returned: 0 in 1.045s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:54 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110
Apr 29 08:41:54 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:54 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (9af83463-eb8a-4132-b172-953a30d3c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb4cbd5-22f0-442b-88c3-b3089fa35030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.874s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:54 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Deleted volume successfully.
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb4cbd5-22f0-442b-88c3-b3089fa35030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1207938672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6eb895-7688-48e1-b335-24a20e94e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6eb895-7688-48e1-b335-24a20e94e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b8820b-524a-4f1d-8620-18752eb582be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b8820b-524a-4f1d-8620-18752eb582be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'volume_name': 'volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cca145-b6bc-47ba-8d6d-983efe551473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cca145-b6bc-47ba-8d6d-983efe551473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab582024-1b67-4ca3-8866-b3f1604c472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Volume ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'volume_size': 1}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-12c28d60-4888-43c6-920d-155a29cdf84d tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-8409c57b-e6b9-4fd4-8280-0fc50d7dceef-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (b95ce888-e268-4a6b-86a6-7728889ccdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fead786a-f102-4fbe-a935-0e2b4bd06cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fead786a-f102-4fbe-a935-0e2b4bd06cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754159986',display_name='tempest-VolumesGetTest-Volume-1985535140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a58e89-db9f-4fde-a52a-e5d162c31c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489ba6cc-6f79-406e-a8c4-93d56d2cf48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489ba6cc-6f79-406e-a8c4-93d56d2cf48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c796c8d9-cd18-401e-aadb-0ea7560c3005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c796c8d9-cd18-401e-aadb-0ea7560c3005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a58e89-db9f-4fde-a52a-e5d162c31c3b', 'volume_name': 'volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340215fc-5e09-4667-b778-ec75087022e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340215fc-5e09-4667-b778-ec75087022e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea5630-6a84-48db-9efe-6829b4e41ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Volume 51a58e89-db9f-4fde-a52a-e5d162c31c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b', 'volume_size': 1}
Apr 29 08:41:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:55 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110" returned: 0 in 0.741s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.926s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9086a613-fcdf-42b3-896f-2f89b8c36070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4752910-1a6b-4501-a11a-4a60af1fe110', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05aa5dd-f182-4338-b08b-bf85b65de903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Creating offline snapshot b9f4c713-5542-4191-981e-f69afd8df202 of volume f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:41:55 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Volume volume-c4752910-1a6b-4501-a11a-4a60af1fe110 (c4752910-1a6b-4501-a11a-4a60af1fe110): created successfully
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f05aa5dd-f182-4338-b08b-bf85b65de903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (ba2183f0-e67d-4974-831a-7199cb765753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e701400b-0e73-426c-8fb8-8e59106a69fd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-42084264-7ae4-4b5b-a6e3-cc67b6ee8a0c tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:41:55 devstack sudo[91009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c
Apr 29 08:41:55 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:55 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" returned: 0 in 0.705s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:55 devstack sudo[91016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 1G
Apr 29 08:41:55 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-c4752910-1a6b-4501-a11a-4a60af1fe110-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "cinder-c4752910-1a6b-4501-a11a-4a60af1fe110-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-quobyte-c4752910-1a6b-4501-a11a-4a60af1fe110" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-c4752910-1a6b-4501-a11a-4a60af1fe110" acquired by "delete_volume" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42c66e-6cab-49a0-9561-409608e949ff]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:56 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110
Apr 29 08:41:56 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:56 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 1G" returned: 0 in 0.799s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:56 devstack sudo[91024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202
Apr 29 08:41:56 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:56 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110" returned: 0 in 0.788s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:56 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110
Apr 29 08:41:56 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:57 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202" returned: 0 in 0.663s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:57 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 is being set with open permissions: ugo+rw
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:57 devstack sudo[91070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202
Apr 29 08:41:57 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:57 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4752910-1a6b-4501-a11a-4a60af1fe110" returned: 0 in 0.691s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-c4752910-1a6b-4501-a11a-4a60af1fe110" released by "delete_volume" :: held 1.525s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Created reservations ['d4743eb3-6940-4827-bda5-f6f1f9180ed1', 'c455735e-7223-4c06-b277-e2b23755fc74', '9cbd6ea2-c807-4048-9845-85bcfcd0caf7', '47a493f7-effd-42d4-a85c-b4c9ffd82787'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:57 devstack sudo[91073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:41:57 devstack sudo[91073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:57 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202" returned: 0 in 0.659s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:57 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info
Apr 29 08:41:57 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:58 devstack sudo[91073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.711s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:41:58 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Deleted volume successfully.
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-99c3f231-6700-4545-a245-3a1e811c0eaa tempest-VolumesActionsTest-2132793594 None] Lock "cinder-c4752910-1a6b-4501-a11a-4a60af1fe110-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:41:58 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info" returned: 0 in 0.639s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:58 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info is being set with open permissions: ugo+rw
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:58 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info
Apr 29 08:41:58 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:58 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (cbc708a1-1fb6-40d0-9896-8ceec9a02f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e3b166-e50b-4eb3-bb89-f50bf0345e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e3b166-e50b-4eb3-bb89-f50bf0345e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152602643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e895e67c-23b0-41da-8452-5326485dcb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:59Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5bbc1b-fb44-43ec-a00d-8640e1942186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5bbc1b-fb44-43ec-a00d-8640e1942186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2929ec15-9841-4899-9988-cd0cb303b559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2929ec15-9841-4899-9988-cd0cb303b559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e895e67c-23b0-41da-8452-5326485dcb21', 'volume_name': 'volume-e895e67c-23b0-41da-8452-5326485dcb21', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b486c3-d036-4380-875d-fbebda1fc7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b486c3-d036-4380-875d-fbebda1fc7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0294eaee-6c43-475c-ad5a-39dfd541d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:41:59 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Volume e895e67c-23b0-41da-8452-5326485dcb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e895e67c-23b0-41da-8452-5326485dcb21', 'volume_size': 1}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:59 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.info" returned: 0 in 0.654s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.245s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.734s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1207938672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:54Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Creating volume ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:41:59 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:59 devstack sudo[91084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 1073741824
Apr 29 08:41:59 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:41:59 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cc09f30b-6b80-481f-8e59-3d40f73e6be2 tempest-CinderUnicodeTest-1096836662 None] Create snapshot completed successfully
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-b9f4c713-5542-4191-981e-f69afd8df202-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-b9f4c713-5542-4191-981e-f69afd8df202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-quobyte-b9f4c713-5542-4191-981e-f69afd8df202" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-b9f4c713-5542-4191-981e-f69afd8df202" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Deleting offline snapshot b9f4c713-5542-4191-981e-f69afd8df202 of volume f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] snapshot_file for this snap is: volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab7394-2f66-4e16-b2fe-e71139e54202]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:41:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:41:59 devstack sudo[91086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202
Apr 29 08:41:59 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:00 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 1073741824" returned: 0 in 0.934s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:00 devstack sudo[91091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:00 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:00 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202" returned: 0 in 0.790s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7211bee2-2082-4469-aa7b-5e5ea68b92e6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:00 devstack sudo[91097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c
Apr 29 08:42:00 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:00 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.712s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.285s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-754159986',display_name='tempest-VolumesGetTest-Volume-1985535140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a58e89-db9f-4fde-a52a-e5d162c31c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:55Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Creating volume 51a58e89-db9f-4fde-a52a-e5d162c31c3b {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:00 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:01 devstack sudo[91100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b 1073741824
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab582024-1b67-4ca3-8866-b3f1604c472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:01 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8d60f4-29cb-40f2-869c-6679b4906598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:01 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Volume volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 (ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9): created successfully
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d8d60f4-29cb-40f2-869c-6679b4906598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (9af83463-eb8a-4132-b172-953a30d3c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:01 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-be2c23e1-7146-41d3-91e2-e5f514b3042f tempest-VolumeDependencyTests-1164748449 None] Created volume successfully.
Apr 29 08:42:01 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" returned: 0 in 0.806s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:01 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202
Apr 29 08:42:01 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:01 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b 1073741824" returned: 0 in 0.895s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:01 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b
Apr 29 08:42:01 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:02 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202" returned: 0 in 0.817s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:02 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202
Apr 29 08:42:02 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (a7167316-ac77-4552-909a-2f40e7646c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0df7d96-9d52-47d0-89c8-9b3c9e406861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0df7d96-9d52-47d0-89c8-9b3c9e406861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1230513201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc06b6d-b740-47d4-92fe-87099030e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc2f0510637846699dcea58982ab316a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:02Z,use_quota=True,user_id='5c2cb6b3a2cf49b69203b2997b230194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014725c1-da3a-41a4-899d-cfeb98b8e13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014725c1-da3a-41a4-899d-cfeb98b8e13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d301633-a45f-4be6-9c1f-f8971904b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d301633-a45f-4be6-9c1f-f8971904b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dbc06b6d-b740-47d4-92fe-87099030e9dc', 'volume_name': 'volume-dbc06b6d-b740-47d4-92fe-87099030e9dc', 'volume_size': 1, 'source_volid': 'ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fbcc3a-d1ac-4e01-a380-67ebd5c74d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fbcc3a-d1ac-4e01-a380-67ebd5c74d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573fc531-d9fa-44a4-b51b-f946f39f436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Volume dbc06b6d-b740-47d4-92fe-87099030e9dc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dbc06b6d-b740-47d4-92fe-87099030e9dc', 'volume_size': 1, 'source_volid': 'ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'source_volstatus': 'available'}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:02 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b" returned: 0 in 0.747s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152602643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e895e67c-23b0-41da-8452-5326485dcb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:41:59Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Creating volume e895e67c-23b0-41da-8452-5326485dcb21 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:02 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:02 devstack sudo[91119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 1073741824
Apr 29 08:42:02 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea5630-6a84-48db-9efe-6829b4e41ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945c68b7-0f5a-4fb0-8252-2a28735d0109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:02 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Volume volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b (51a58e89-db9f-4fde-a52a-e5d162c31c3b): created successfully
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945c68b7-0f5a-4fb0-8252-2a28735d0109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (b95ce888-e268-4a6b-86a6-7728889ccdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5cd368e5-14f9-46df-859e-be5469a64675 tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:42:02 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c.b9f4c713-5542-4191-981e-f69afd8df202" returned: 0 in 0.766s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-b9f4c713-5542-4191-981e-f69afd8df202" released by "_delete_snapshot" :: held 3.308s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" released by "delete_snapshot" :: held 3.346s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:02 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Created reservations ['453393cb-a15a-494c-abc3-0a955a648242', 'ce573ff1-4e86-4e7f-b3ba-b92bacf3a39b', '8460412c-c015-499f-9b4f-bf1ef24208e9', '141b7b87-9ac2-4012-a4cd-519c11915adf'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Delete snapshot completed successfully.
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cf89077-997b-41a9-ae49-bebb5cadb2e1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-b9f4c713-5542-4191-981e-f69afd8df202-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-51a58e89-db9f-4fde-a52a-e5d162c31c3b-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "cinder-51a58e89-db9f-4fde-a52a-e5d162c31c3b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-51a58e89-db9f-4fde-a52a-e5d162c31c3b" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-51a58e89-db9f-4fde-a52a-e5d162c31c3b" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a5b87-2a3c-4984-ad37-64c058ba0f2b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:03 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 1073741824" returned: 0 in 0.977s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:03 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b
Apr 29 08:42:03 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:03 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21
Apr 29 08:42:03 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[78925263-955a-44d1-8419-917fd83e730c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:04 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c
Apr 29 08:42:04 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:04 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:04 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b" returned: 0 in 0.823s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21" returned: 0 in 0.691s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.923s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:04 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Cloning volume ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 to volume dbc06b6d-b740-47d4-92fe-87099030e9dc
Apr 29 08:42:04 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b
Apr 29 08:42:04 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0294eaee-6c43-475c-ad5a-39dfd541d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e895e67c-23b0-41da-8452-5326485dcb21', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14debbec-2e4a-4ab7-99b6-177c4929ae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:04 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Volume volume-e895e67c-23b0-41da-8452-5326485dcb21 (e895e67c-23b0-41da-8452-5326485dcb21): created successfully
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14debbec-2e4a-4ab7-99b6-177c4929ae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (cbc708a1-1fb6-40d0-9896-8ceec9a02f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5e3a2254-a2d3-4f8b-8a7e-334532f2b008 tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Creating offline snapshot 08a42a47-09c6-43d0-9055-eaa93d4247b4 of volume ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eeef39-f648-41d7-a434-d1905649589e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:04 devstack sudo[91138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:04 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:04 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" returned: 0 in 0.830s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:04 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c
Apr 29 08:42:04 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-51a58e89-db9f-4fde-a52a-e5d162c31c3b" returned: 0 in 0.643s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-51a58e89-db9f-4fde-a52a-e5d162c31c3b" released by "delete_volume" :: held 1.511s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Created reservations ['e09dfebe-71c5-468d-b71c-27ef998e4116', 'f7c65775-e53e-4fc4-a6b2-3203fd920554', '2f6b5bcf-c1f9-4cc9-b8a0-bef073a7cc76', '8d97c516-727c-4b6f-ba3b-b84c4d73fbbb'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:05 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:05 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.874s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:05 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" returned: 0 in 0.645s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:05 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 1G
Apr 29 08:42:05 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c" released by "delete_volume" :: held 1.581s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Created reservations ['b44c4ba5-7cd3-409e-bfe7-f050ee68283f', 'e5d7d88f-fd43-46c1-9c4a-e7461b28c29a', '11b6364f-44a9-47a9-9e1e-e804b4f7a588', '4f63856f-599d-4c67-84ed-e18e8333be84'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:05 devstack sudo[91155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:05 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-6b646416-737b-4e34-bfcd-29aa3b5913af-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-e895e67c-23b0-41da-8452-5326485dcb21-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "cinder-6b646416-737b-4e34-bfcd-29aa3b5913af-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-e895e67c-23b0-41da-8452-5326485dcb21-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-quobyte-e895e67c-23b0-41da-8452-5326485dcb21" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:06 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-6b646416-737b-4e34-bfcd-29aa3b5913af" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.941s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-e895e67c-23b0-41da-8452-5326485dcb21" acquired by "delete_volume" :: waited 0.037s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[99729f47-d3c8-4ac0-a94b-10292de8cbb2]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-6b646416-737b-4e34-bfcd-29aa3b5913af" acquired by "delete_volume" :: waited 0.059s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc91a4e-5655-423c-93bd-e3bac328c917]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4a530327-7b5c-45af-a9e7-5c719efa0b17 tempest-VolumesGetTest-992756515 None] Lock "cinder-51a58e89-db9f-4fde-a52a-e5d162c31c3b-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "cinder-quobyte-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c1af6a-3a4f-4111-80b2-4a8b5c85e207]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af
Apr 29 08:42:06 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:06 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21
Apr 29 08:42:06 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:06 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3
Apr 29 08:42:06 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:06 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.862s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Deleted volume successfully.
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-597c0e25-3e1f-4997-aaa3-c22414a94fd1 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-f942b1c9-5480-4b76-a0bd-e3d5ec2ccf2c-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:06 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 1G" returned: 0 in 1.200s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:06 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:06 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21" returned: 0 in 0.868s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af" returned: 0 in 0.881s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21
Apr 29 08:42:07 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af
Apr 29 08:42:07 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" returned: 0 in 0.983s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3
Apr 29 08:42:07 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.791s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 is being set with open permissions: ugo+rw
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:07 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e895e67c-23b0-41da-8452-5326485dcb21" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-e895e67c-23b0-41da-8452-5326485dcb21" released by "delete_volume" :: held 1.601s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Created reservations ['b25f1526-fc01-4fdb-98ae-dde21ef5f254', 'ac192788-03e3-4b34-b309-cf758b98e480', '3acee750-cb7c-4a1c-9e91-4eae962e4630', '1b1013b1-fb23-4e7c-a941-3d6fc014e996'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:07 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6b646416-737b-4e34-bfcd-29aa3b5913af" returned: 0 in 0.753s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-6b646416-737b-4e34-bfcd-29aa3b5913af" released by "delete_volume" :: held 1.689s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:07 devstack sudo[91194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:07 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Created reservations ['ec0c4d93-c5fa-45c9-b2f7-9bb175577a3f', 'ca0c5b4f-5859-4262-a4ed-ba526a87d1eb', '0baf9043-533a-4a10-9691-424c3264b414', 'b9dd8c75-027d-478a-8c24-18e8af35e1e2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:07 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" returned: 0 in 0.679s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-quobyte-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3" released by "delete_volume" :: held 1.720s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:08 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.715s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:08 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:08 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Created reservations ['4268b433-c833-49cb-bb93-b69d4a10145e', '70e589ad-e865-4fea-ab82-bc3c349366a7', '208d0018-05db-45e6-83fa-e4e89c6087e3', 'ac1dfbf4-fcd6-48f8-bccd-50c1fb3bdd03'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:08 devstack sudo[91199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info
Apr 29 08:42:08 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:08 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:08 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:09 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.074s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:09 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (d4d11112-cc04-4a25-a287-c9c5c6b8c64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a750d5bb-b877-47f9-bdad-189684705960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.394s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a750d5bb-b877-47f9-bdad-189684705960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494608522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a4ce3f-09fd-444f-b780-ab9437c0904a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:09Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63828861-7c85-4a74-9ff7-09bb4a6d8e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63828861-7c85-4a74-9ff7-09bb4a6d8e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f04644-3f73-440b-aaae-d9bb1bf05f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f04644-3f73-440b-aaae-d9bb1bf05f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16a4ce3f-09fd-444f-b780-ab9437c0904a', 'volume_name': 'volume-16a4ce3f-09fd-444f-b780-ab9437c0904a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd47ea9-37ad-4399-b69f-66a75036da2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd47ea9-37ad-4399-b69f-66a75036da2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34adc860-a1b0-4084-9b92-01e1325aa736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Volume 16a4ce3f-09fd-444f-b780-ab9437c0904a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16a4ce3f-09fd-444f-b780-ab9437c0904a', 'volume_size': 1}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Deleted volume successfully.
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7c6470f4-f10f-46b9-a28c-805723d1f174 tempest-VolumesGetTest-992756515 None] Lock "cinder-6b646416-737b-4e34-bfcd-29aa3b5913af-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (bf2376d4-23e6-4513-82f5-e79de90cafd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30f953f-a3d1-4144-875d-e38d177c109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-29479d93-33db-4c74-baca-d503248d4eb8 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-e895e67c-23b0-41da-8452-5326485dcb21-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30f953f-a3d1-4144-875d-e38d177c109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394980238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0497a3-a9d2-4e10-8172-6c51569b85a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:09Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74bf54a-3d92-433d-83c3-4d4fd09ac1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74bf54a-3d92-433d-83c3-4d4fd09ac1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5503c43-ddf6-4426-8cc4-05bdcc6079a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5503c43-ddf6-4426-8cc4-05bdcc6079a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0497a3-a9d2-4e10-8172-6c51569b85a5', 'volume_name': 'volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc56f856-0275-4feb-afd6-424b4320f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc56f856-0275-4feb-afd6-424b4320f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08006c45-2e26-4e07-8527-103a9634ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:09 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Volume 2a0497a3-a9d2-4e10-8172-6c51569b85a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5', 'volume_size': 1}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:09 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info" returned: 0 in 1.309s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:09 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info is being set with open permissions: ugo+rw
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:09 devstack sudo[91206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info
Apr 29 08:42:09 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:09 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.307s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:09 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Deleted volume successfully.
Apr 29 08:42:09 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ac06c958-6831-4b78-ab5e-95000960fc22 tempest-CinderUnicodeTest-1096836662 None] Lock "cinder-4fe310bc-d833-4e47-8cce-cc8aedf3a3c3-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:10 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.info" returned: 0 in 0.637s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] snapshot: 08a42a47-09c6-43d0-9055-eaa93d4247b4, volume: dbc06b6d-b740-47d4-92fe-87099030e9dc,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[903fde03-dfe7-4fb9-a8d2-d161c8562617]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:10 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:10 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:10 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.777s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0027522-4aa2-4a26-85e0-6e0e262d694a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:11 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:11 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:11 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.712s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:11 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:42:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:11 devstack sudo[91221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc
Apr 29 08:42:11 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:16 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc" returned: 0 in 4.624s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b3692-c311-4064-8ef1-7df0eb5e8687]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:16 devstack sudo[91240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:16 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:16 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:16 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:17 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.968s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:42:17 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Converted 1024.00 MB image at 221.40 MB/s
Apr 29 08:42:17 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc is being set with open permissions: ugo+rw
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:17 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc
Apr 29 08:42:17 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:17 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:17 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc" returned: 0 in 0.671s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" released by "_copy_volume_from_snapshot" :: held 7.856s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-08a42a47-09c6-43d0-9055-eaa93d4247b4" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-08a42a47-09c6-43d0-9055-eaa93d4247b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Deleting offline snapshot 08a42a47-09c6-43d0-9055-eaa93d4247b4 of volume ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] snapshot_file for this snap is: volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aacc719-62b1-4f5f-baea-fd6491f66d3a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:18 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:18 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:18 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.706s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20245e76-f70d-40e6-90fc-28c0c962549f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:18 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:18 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:19 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=86,cinder:INSERT=26,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:19 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.714s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:19 devstack sudo[91261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:19 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:20 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.705s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:20 devstack sudo[91266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4
Apr 29 08:42:20 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:20 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9.08a42a47-09c6-43d0-9055-eaa93d4247b4" returned: 0 in 0.620s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-08a42a47-09c6-43d0-9055-eaa93d4247b4" released by "_delete_snapshot" :: held 2.844s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.512s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.606s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494608522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16a4ce3f-09fd-444f-b780-ab9437c0904a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:09Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Creating volume 16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:20 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:20 devstack sudo[91270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a 1073741824
Apr 29 08:42:20 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573fc531-d9fa-44a4-b51b-f946f39f436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc06b6d-b740-47d4-92fe-87099030e9dc', 'volume_size': 1, 'source_volid': 'ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bce6d8-37eb-4432-afb2-743fd621098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Volume volume-dbc06b6d-b740-47d4-92fe-87099030e9dc (dbc06b6d-b740-47d4-92fe-87099030e9dc): created successfully
Apr 29 08:42:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bce6d8-37eb-4432-afb2-743fd621098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Flow 'volume_create_manager' (a7167316-ac77-4552-909a-2f40e7646c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:21 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b833ec0b-a8e8-46aa-8ace-728f8dc347c8 tempest-VolumeDependencyTests-1164748449 None] Created volume successfully.
Apr 29 08:42:21 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a 1073741824" returned: 0 in 0.802s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:21 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:21 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" acquired by "delete_volume" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b27fb7-f8d5-4628-b658-11aa7046db80]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:22 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:22 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:22 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.641s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.963s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1394980238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0497a3-a9d2-4e10-8172-6c51569b85a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:09Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Creating volume 2a0497a3-a9d2-4e10-8172-6c51569b85a5 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:22 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34adc860-a1b0-4084-9b92-01e1325aa736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16a4ce3f-09fd-444f-b780-ab9437c0904a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:22 devstack sudo[91280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 1073741824
Apr 29 08:42:22 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e105adb-d83f-4164-9420-efd49791ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Volume volume-16a4ce3f-09fd-444f-b780-ab9437c0904a (16a4ce3f-09fd-444f-b780-ab9437c0904a): created successfully
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e105adb-d83f-4164-9420-efd49791ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (d4d11112-cc04-4a25-a287-c9c5c6b8c64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5505c315-e0ea-4b96-8552-29edff7a6535 tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:42:23 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.795s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:23 devstack sudo[91288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9
Apr 29 08:42:23 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:23 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 1073741824" returned: 0 in 0.953s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:23 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5
Apr 29 08:42:23 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (7a2dd030-bcb1-4a31-b3fc-edb270918957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839338c3-9e16-4e8b-8213-0c8cd86bdd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839338c3-9e16-4e8b-8213-0c8cd86bdd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-471729202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee2caba-a16d-408c-a551-875bf160edb1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=16a4ce3f-09fd-444f-b780-ab9437c0904a,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:23Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6c10e8-317f-4533-aa24-54b7da16fa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6c10e8-317f-4533-aa24-54b7da16fa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd84ea-d944-4461-9367-60595ebc8dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd84ea-d944-4461-9367-60595ebc8dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ee2caba-a16d-408c-a551-875bf160edb1', 'volume_name': 'volume-4ee2caba-a16d-408c-a551-875bf160edb1', 'volume_size': 1, 'source_volid': '16a4ce3f-09fd-444f-b780-ab9437c0904a', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20367ef-daf8-4f92-b616-1e765d5bf958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20367ef-daf8-4f92-b616-1e765d5bf958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb3ab20-d396-4da6-8f21-1f30cfbf29e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Volume 4ee2caba-a16d-408c-a551-875bf160edb1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ee2caba-a16d-408c-a551-875bf160edb1', 'volume_size': 1, 'source_volid': '16a4ce3f-09fd-444f-b780-ab9437c0904a', 'source_volstatus': 'available'}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:23 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" returned: 0 in 0.755s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9" released by "delete_volume" :: held 1.618s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Created reservations ['9530ad2f-9e57-414f-8b17-95a707084f1c', '196fdb48-3654-482b-9add-01d96ffbc9f1', '88fbebcf-8afc-4209-ac89-da962a4a13c8', 'a552f647-e2a6-4980-86bd-a57e83938a7b'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:23 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:23 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:24 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5" returned: 0 in 0.644s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.427s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:24 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Cloning volume 16a4ce3f-09fd-444f-b780-ab9437c0904a to volume 4ee2caba-a16d-408c-a551-875bf160edb1
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08006c45-2e26-4e07-8527-103a9634ec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a373d19-0862-4347-a0a4-a2ee352aff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Creating offline snapshot b4a04166-52f7-40c0-9d53-ac62c06ace78 of volume 16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:42:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Volume volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 (2a0497a3-a9d2-4e10-8172-6c51569b85a5): created successfully
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a373d19-0862-4347-a0a4-a2ee352aff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (bf2376d4-23e6-4513-82f5-e79de90cafd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e864c1b-f689-45e9-9fad-0807a1eaae6f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b56dc87f-b536-40a5-b13e-c133054490cc tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:42:24 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:24 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-dbc06b6d-b740-47d4-92fe-87099030e9dc-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-dbc06b6d-b740-47d4-92fe-87099030e9dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e0d3f-3839-4e1a-b567-326fdd34b542]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-2a0497a3-a9d2-4e10-8172-6c51569b85a5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-2a0497a3-a9d2-4e10-8172-6c51569b85a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-quobyte-2a0497a3-a9d2-4e10-8172-6c51569b85a5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-2a0497a3-a9d2-4e10-8172-6c51569b85a5" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:24 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.795s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:24 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc
Apr 29 08:42:24 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1dc2b-a3b2-42b5-877d-0d8199739c4f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Deleted volume successfully.
Apr 29 08:42:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a26afcd9-cbf3-4dfb-9c82-1ef405d6fc57 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-ddf886da-a0a1-4aec-a035-8ff6ad8b0ae9-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:24 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5
Apr 29 08:42:24 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:25 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.851s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:25 devstack sudo[91306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 1G
Apr 29 08:42:25 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:25 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc" returned: 0 in 0.838s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:25 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc
Apr 29 08:42:25 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:25 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5" returned: 0 in 0.776s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:25 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5
Apr 29 08:42:25 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:25 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 1G" returned: 0 in 0.817s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4ce3f-09fd-444f-b780-ab9437c0904a -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:25 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4ce3f-09fd-444f-b780-ab9437c0904a -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:25 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-dbc06b6d-b740-47d4-92fe-87099030e9dc" returned: 0 in 0.652s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-dbc06b6d-b740-47d4-92fe-87099030e9dc" released by "delete_volume" :: held 1.573s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:26 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2a0497a3-a9d2-4e10-8172-6c51569b85a5" returned: 0 in 0.655s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-2a0497a3-a9d2-4e10-8172-6c51569b85a5" released by "delete_volume" :: held 1.485s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Created reservations ['de53d4c9-7388-4bde-a6bc-5b96242505e0', '5dcc011d-e05e-4351-83d0-891ba8083bd4', 'd0b628f0-9530-473f-8209-034150777813', '4c54c83b-5a3f-4f55-b021-17a131bc29bf'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Created reservations ['945579ed-1f97-4a3c-bba4-367ed49a7f71', '68eb5dd5-b642-4f15-99b3-061d3cc68c3c', 'ac589a59-15a3-49bf-beab-0796bc2e6d88', '7686f573-9396-4b83-ba99-4b9739e477a0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:26 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:26 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:26 devstack sudo[91332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:26 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16a4ce3f-09fd-444f-b780-ab9437c0904a -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.709s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:26 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 is being set with open permissions: ugo+rw
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:26 devstack sudo[91335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:26 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-6d5810ec-ea57-4867-b424-03988b79ffef-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-6d5810ec-ea57-4867-b424-03988b79ffef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e9a04-16c1-4d5f-8bb0-723c024476b4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:27 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.728s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Deleted volume successfully.
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7fce8046-0b08-4957-9c36-7d37c0459e06 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-dbc06b6d-b740-47d4-92fe-87099030e9dc-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:27 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef
Apr 29 08:42:27 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:27 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.835s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Deleted volume successfully.
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5e519a2e-0b8d-4897-85f1-4ba44d9023a4 tempest-VolumesActionsTest-2132793594 None] Lock "cinder-2a0497a3-a9d2-4e10-8172-6c51569b85a5-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:27 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.807s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:27 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info
Apr 29 08:42:27 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (48ccc03c-8485-43ed-b4ff-e5259e69edad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11f5a94-bc04-4702-ac6c-ddc5c4cded1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11f5a94-bc04-4702-ac6c-ddc5c4cded1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738838473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5af712-f63f-400e-bf3a-b4760115125f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:27Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8742dcd7-f8b4-4dde-8341-77bca284ca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8742dcd7-f8b4-4dde-8341-77bca284ca3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4acbf1-19d5-45c6-be04-4c94999c1a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4acbf1-19d5-45c6-be04-4c94999c1a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5af712-f63f-400e-bf3a-b4760115125f', 'volume_name': 'volume-df5af712-f63f-400e-bf3a-b4760115125f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71afdbda-8159-47a5-9ed5-c226964b4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71afdbda-8159-47a5-9ed5-c226964b4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bed1e8-831e-4271-9dca-84e1ec90d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:27 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Volume df5af712-f63f-400e-bf3a-b4760115125f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5af712-f63f-400e-bf3a-b4760115125f', 'volume_size': 1}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:27 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef" returned: 0 in 0.886s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:27 devstack sudo[91347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef
Apr 29 08:42:27 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:28 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:28 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info is being set with open permissions: ugo+rw
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:28 devstack sudo[91350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info
Apr 29 08:42:28 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:28 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6d5810ec-ea57-4867-b424-03988b79ffef" returned: 0 in 0.674s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-quobyte-6d5810ec-ea57-4867-b424-03988b79ffef" released by "delete_volume" :: held 1.614s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Created reservations ['cf9545b0-909e-46c2-a156-4d7d3a36eba3', '390bb597-0447-4f84-8303-58bff7b946ed', '34a356c1-0748-4661-b470-773dc430df21', '41291548-1809-4acc-8eac-ebb3b162c86e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:28 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.info" returned: 0 in 0.645s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:28 devstack sudo[91354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:28 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] snapshot: b4a04166-52f7-40c0-9d53-ac62c06ace78, volume: 4ee2caba-a16d-408c-a551-875bf160edb1,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe5e2c6-0d8c-4d17-9ba9-b5106055f38a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:28 devstack sudo[91356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:28 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:29 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.678s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:29 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Deleted volume successfully.
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-945c750d-d9d4-466e-84e6-abe63849a147 tempest-VolumeDependencyTests-1164748449 None] Lock "cinder-6d5810ec-ea57-4867-b424-03988b79ffef-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:29 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.750s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a4ce3f-09fd-444f-b780-ab9437c0904a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5392781-c9b5-4c0e-a1a6-7e522488e5af]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:29 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:29 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:30 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.758s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:30 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:42:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:30 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1
Apr 29 08:42:30 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:35 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1" returned: 0 in 5.222s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[617ce427-9a0e-44db-8476-ad2fcf2f2780]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:35 devstack sudo[91382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:35 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:36 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.938s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:36 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:42:36 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Converted 1024.00 MB image at 196.04 MB/s
Apr 29 08:42:36 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 is being set with open permissions: ugo+rw
Apr 29 08:42:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:36 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1
Apr 29 08:42:36 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:37 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1" returned: 0 in 0.646s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" released by "_copy_volume_from_snapshot" :: held 8.411s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-b4a04166-52f7-40c0-9d53-ac62c06ace78" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-b4a04166-52f7-40c0-9d53-ac62c06ace78" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Deleting offline snapshot b4a04166-52f7-40c0-9d53-ac62c06ace78 of volume 16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] snapshot_file for this snap is: volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9fd06f-eba9-4d9c-8947-c9c24a752a7b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:37 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:37 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:38 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.773s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16a4ce3f-09fd-444f-b780-ab9437c0904a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c40963-e948-4603-a114-cba517841115]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:38 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:38 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=46,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=7 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:38 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.746s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:38 devstack sudo[91400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:38 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:39 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.772s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:39 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78
Apr 29 08:42:39 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:40 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a.b4a04166-52f7-40c0-9d53-ac62c06ace78" returned: 0 in 0.684s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-b4a04166-52f7-40c0-9d53-ac62c06ace78" released by "_delete_snapshot" :: held 3.085s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=108,cinder:INSERT=46,cinder:UPDATE=155,cinder:DELETE=11 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.393s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.875s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-738838473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5af712-f63f-400e-bf3a-b4760115125f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:27Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Creating volume df5af712-f63f-400e-bf3a-b4760115125f {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:40 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:40 devstack sudo[91409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f 1073741824
Apr 29 08:42:40 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb3ab20-d396-4da6-8f21-1f30cfbf29e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee2caba-a16d-408c-a551-875bf160edb1', 'volume_size': 1, 'source_volid': '16a4ce3f-09fd-444f-b780-ab9437c0904a', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7502ff-dd61-420b-9440-e21dc09e70ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Volume volume-4ee2caba-a16d-408c-a551-875bf160edb1 (4ee2caba-a16d-408c-a551-875bf160edb1): created successfully
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7502ff-dd61-420b-9440-e21dc09e70ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (7a2dd030-bcb1-4a31-b3fc-edb270918957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-69c5bfbb-c01d-4cce-8770-febc05fa883b tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:42:41 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f 1073741824" returned: 0 in 1.111s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:41 devstack sudo[91415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f
Apr 29 08:42:41 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (b17051d2-8fc0-409d-8ccb-81b83d8ef974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f897012-4174-4670-a650-e14e29dbd329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f897012-4174-4670-a650-e14e29dbd329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-260637749',display_name='tempest-VolumesGetTest-Volume-1363413106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:42Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab383f2-bdec-4eb8-954f-f9bbf07e6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab383f2-bdec-4eb8-954f-f9bbf07e6773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3783e5-98be-4740-a968-905b1e2cb4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3783e5-98be-4740-a968-905b1e2cb4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8', 'volume_name': 'volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cbbbb5-8804-428a-996b-121e01701b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cbbbb5-8804-428a-996b-121e01701b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a54a908-7138-4900-a6ae-4a21fde2742b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Volume 21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8', 'volume_size': 1}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:42 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f" returned: 0 in 0.865s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-260637749',display_name='tempest-VolumesGetTest-Volume-1363413106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:42Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Creating volume 21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:42 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:42 devstack sudo[91418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 1073741824
Apr 29 08:42:42 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bed1e8-831e-4271-9dca-84e1ec90d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5af712-f63f-400e-bf3a-b4760115125f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a838ac-2922-4a29-a412-5bee67b69cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:42 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Volume volume-df5af712-f63f-400e-bf3a-b4760115125f (df5af712-f63f-400e-bf3a-b4760115125f): created successfully
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a838ac-2922-4a29-a412-5bee67b69cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (48ccc03c-8485-43ed-b4ff-e5259e69edad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f768a23d-5a70-402b-b690-f016625cc217 tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-df5af712-f63f-400e-bf3a-b4760115125f-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "cinder-df5af712-f63f-400e-bf3a-b4760115125f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Acquiring lock "cinder-quobyte-df5af712-f63f-400e-bf3a-b4760115125f" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-df5af712-f63f-400e-bf3a-b4760115125f" acquired by "delete_volume" :: waited 0.034s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[50daa06b-dd30-465a-bd09-d39e77790db9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:43 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f
Apr 29 08:42:43 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 1073741824" returned: 0 in 1.304s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:43 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:43 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8
Apr 29 08:42:43 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:44 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f" returned: 0 in 1.145s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:44 devstack sudo[91433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f
Apr 29 08:42:44 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:44 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" returned: 0 in 0.832s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a54a908-7138-4900-a6ae-4a21fde2742b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce669e7-48ba-4235-bd6a-a3818561f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:44 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Volume volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 (21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8): created successfully
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ce669e7-48ba-4235-bd6a-a3818561f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:44 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (b17051d2-8fc0-409d-8ccb-81b83d8ef974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-99684280-62d9-4024-a8d5-b19f0f4d324d tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:42:45 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-df5af712-f63f-400e-bf3a-b4760115125f" returned: 0 in 0.787s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "cinder-quobyte-df5af712-f63f-400e-bf3a-b4760115125f" released by "delete_volume" :: held 2.009s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Created reservations ['6de32760-b399-44cd-ab62-ce1ef7135c4d', '75459733-24ea-48ab-95f3-b361392f7c66', '80a075de-0ca9-431a-9985-fdd5097134cc', '7f1a76c9-bda8-42c5-82e3-1d6ca71b4343'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:45 devstack sudo[91438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:45 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "cinder-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a56eab-4f2d-4a31-84b6-a2577d70b42e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:45 devstack sudo[91440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8
Apr 29 08:42:45 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:46 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.726s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:46 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Deleted volume successfully.
Apr 29 08:42:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df6928b4-0936-48dd-85e8-fd084298366b tempest-VolumesActionsTest-2132793594 None] Lock "cinder-df5af712-f63f-400e-bf3a-b4760115125f-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:46 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" returned: 0 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:46 devstack sudo[91446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8
Apr 29 08:42:46 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (fe2b4a0d-4cd8-44a7-a0d8-291d1d07b6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:47 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e698595-d533-463f-9051-28bd3d7a35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" returned: 0 in 0.688s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e698595-d533-463f-9051-28bd3d7a35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2000091112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa604fd0-f0fe-4804-8219-3e6d395352f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:47Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ae1f55-c7d9-422b-b653-62f7e40bc651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ae1f55-c7d9-422b-b653-62f7e40bc651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616fba9-7f8f-475a-813c-1c64070c113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e616fba9-7f8f-475a-813c-1c64070c113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa604fd0-f0fe-4804-8219-3e6d395352f5', 'volume_name': 'volume-fa604fd0-f0fe-4804-8219-3e6d395352f5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fa12fa-d40a-48ae-92e6-8a461b836fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fa12fa-d40a-48ae-92e6-8a461b836fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bfcc8f-559c-4fbd-8057-5e2648c19a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:47 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Volume fa604fd0-f0fe-4804-8219-3e6d395352f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa604fd0-f0fe-4804-8219-3e6d395352f5', 'volume_size': 1}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2000091112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa604fd0-f0fe-4804-8219-3e6d395352f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b1cb06db984aaea83916cc24201fd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:47Z,use_quota=True,user_id='17cb16b11f9e4e1885db74d2f2118eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Creating volume fa604fd0-f0fe-4804-8219-3e6d395352f5 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:47 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8" released by "delete_volume" :: held 1.643s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:47 devstack sudo[91449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 1073741824
Apr 29 08:42:47 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Created reservations ['56984844-c02a-4769-b7cb-5e73f3b65e18', '9ebdda26-853e-408d-bcc8-4a60e6620334', 'e292feaf-f490-4228-8250-b45471162950', 'a056e69a-f0c4-42c4-8756-046c4aa27115'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:47 devstack sudo[91451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:47 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-4ee2caba-a16d-408c-a551-875bf160edb1-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "cinder-4ee2caba-a16d-408c-a551-875bf160edb1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b099063-f0d1-4f06-afbb-a9b707a589c3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:48 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.725s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-6de9d7d7-a0e6-48a5-8574-fafc98ecab31 tempest-VolumesGetTest-992756515 None] Lock "cinder-21193ff9-5bfe-4bfc-ba7a-ce0b30174cb8-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:48 devstack sudo[91458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1
Apr 29 08:42:48 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:48 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 1073741824" returned: 0 in 1.016s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:48 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5
Apr 29 08:42:48 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:48 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1" returned: 0 in 0.800s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:48 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1
Apr 29 08:42:48 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:49 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5" returned: 0 in 0.666s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bfcc8f-559c-4fbd-8057-5e2648c19a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa604fd0-f0fe-4804-8219-3e6d395352f5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297af83d-78c0-4f24-a3fe-5989f6d38871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Volume volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 (fa604fd0-f0fe-4804-8219-3e6d395352f5): created successfully
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297af83d-78c0-4f24-a3fe-5989f6d38871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Flow 'volume_create_manager' (fe2b4a0d-4cd8-44a7-a0d8-291d1d07b6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-59dbe415-1444-4ff3-b680-325ea9af3047 tempest-VolumesActionsTest-1833347450 None] Created volume successfully.
Apr 29 08:42:49 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4ee2caba-a16d-408c-a551-875bf160edb1" returned: 0 in 0.730s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-4ee2caba-a16d-408c-a551-875bf160edb1" released by "delete_volume" :: held 1.585s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Created reservations ['82e92756-194a-4546-9331-41cfc0ffd387', 'b75003b6-e720-445c-b510-7da22cf8051e', '3b4ac72b-21f6-4775-9f72-253d43e946f3', 'dbb38044-e641-4d87-be5d-fb1379361890'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:49 devstack sudo[91471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:49 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-fa604fd0-f0fe-4804-8219-3e6d395352f5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "cinder-fa604fd0-f0fe-4804-8219-3e6d395352f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Acquiring lock "cinder-quobyte-fa604fd0-f0fe-4804-8219-3e6d395352f5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "cinder-quobyte-fa604fd0-f0fe-4804-8219-3e6d395352f5" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0564030-6ece-41d6-8299-ecfe37453006]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-16a4ce3f-09fd-444f-b780-ab9437c0904a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "cinder-16a4ce3f-09fd-444f-b780-ab9437c0904a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:50 devstack sudo[91473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5
Apr 29 08:42:50 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-16a4ce3f-09fd-444f-b780-ab9437c0904a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-16a4ce3f-09fd-444f-b780-ab9437c0904a" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aafbe3-f655-4df7-886d-33fe003461b0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:50 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.933s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:50 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:42:50 devstack sudo[91477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:50 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ad808858-745e-484d-83b2-9043cfba2446 tempest-VolumesGetTest-992756515 None] Lock "cinder-4ee2caba-a16d-408c-a551-875bf160edb1-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:51 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5" returned: 0 in 1.044s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:51 devstack sudo[91485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5
Apr 29 08:42:51 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:51 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.894s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:51 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a
Apr 29 08:42:51 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:52 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-fa604fd0-f0fe-4804-8219-3e6d395352f5" returned: 0 in 0.916s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "cinder-quobyte-fa604fd0-f0fe-4804-8219-3e6d395352f5" released by "delete_volume" :: held 2.049s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:52 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Created reservations ['0722bd1d-2960-480a-beed-83605e6c8e09', 'c7c255c2-8feb-4f2b-b839-23f8e9b37e89', '5d48ae7d-cd92-4330-b7a5-468e6e7c460a', '9f760b51-757d-498a-b0ea-8c2ddd763065'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-16a4ce3f-09fd-444f-b780-ab9437c0904a" returned: 0 in 0.857s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-16a4ce3f-09fd-444f-b780-ab9437c0904a" released by "delete_volume" :: held 1.841s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Created reservations ['c8d0dc2d-2cfd-4cc7-827a-dd72021d9a81', '09eb7c0c-6acb-4429-a2ee-161c5450b44f', '5234480d-7bf0-446d-856b-e0b05afd9a00', 'c4f6bb92-22ba-4eaf-bda7-71fc4d7bbee2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:42:52 devstack sudo[91493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:52 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:52 devstack sudo[91495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:42:52 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:53 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.811s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-54738748-708f-4063-ac8f-4b8f1d414d29 tempest-VolumesGetTest-992756515 None] Lock "cinder-16a4ce3f-09fd-444f-b780-ab9437c0904a-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:53 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.134s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:42:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Deleted volume successfully.
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7209ef48-a782-43ec-a830-9e224db8a5ac tempest-VolumesActionsTest-1833347450 None] Lock "cinder-fa604fd0-f0fe-4804-8219-3e6d395352f5-delete_volume" released by "delete_volume" :: held 3.554s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (73497289-78b8-496a-9b98-38ad56ac7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359928ba-ea44-4106-9fdf-427b1f59986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359928ba-ea44-4106-9fdf-427b1f59986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2145834687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52ced21-f828-4a3b-a3b1-f29d0b56f951,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:54Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b1a060-e159-42d4-bc45-167b373d70d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b1a060-e159-42d4-bc45-167b373d70d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d887e46b-5188-462d-a179-e108f68da78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:53 devstack cinder-volume[84102]: DEBUG cinder.image.glance [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Creating Keystone auth plugin from conf {{(pid=84102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d887e46b-5188-462d-a179-e108f68da78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a52ced21-f828-4a3b-a3b1-f29d0b56f951', 'volume_name': 'volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478d65eb0>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720bbde5-babb-42e7-858e-78984f9143ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720bbde5-babb-42e7-858e-78984f9143ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c401461-8e62-45a8-bb47-c752fcde0561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Volume a52ced21-f828-4a3b-a3b1-f29d0b56f951: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478d65eb0>}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Trying to clone a52ced21-f828-4a3b-a3b1-f29d0b56f951 from image 000942db-1254-4464-b86b-8409e1be6077 at location (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]). {{(pid=84102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 08:42:54 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ce94d-b0fc-48c5-a997-22a03407cb71]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:55 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD
Apr 29 08:42:55 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:55 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD" returned: 0 in 0.792s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:55 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 is fetched for user cd276632f5b442aaba33ba28c6659e5e. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 08:42:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c34bc4f-c9c0-454c-ab5c-3865b4c02223]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:55 devstack sudo[91507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD
Apr 29 08:42:55 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:56 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD" returned: 0 in 0.867s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2145834687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52ced21-f828-4a3b-a3b1-f29d0b56f951,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:54Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Creating volume a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:56 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:56 devstack sudo[91512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1073741824
Apr 29 08:42:56 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Flow 'volume_create_manager' (aad3acce-e3fe-4c7e-bf8a-639a77248b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af32031b-66e1-489e-82d2-0a0962c4c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af32031b-66e1-489e-82d2-0a0962c4c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-231934652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72171668-fcfa-4195-8aff-ab272ca3656c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd48b4a6d684055a7f6411d69187ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:57Z,use_quota=True,user_id='097419b3c8ec4909887d09608520e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e77c546-d6a9-4f86-b8d4-2558cf87fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e77c546-d6a9-4f86-b8d4-2558cf87fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09789bc3-bf12-4603-b8e4-4a827359688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09789bc3-bf12-4603-b8e4-4a827359688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72171668-fcfa-4195-8aff-ab272ca3656c', 'volume_name': 'volume-72171668-fcfa-4195-8aff-ab272ca3656c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301e09b2-a935-4dea-ac5c-72dc66cbccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301e09b2-a935-4dea-ac5c-72dc66cbccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3a419e-1699-4491-8400-3eb467002111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:42:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Volume 72171668-fcfa-4195-8aff-ab272ca3656c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72171668-fcfa-4195-8aff-ab272ca3656c', 'volume_size': 1}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:57 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1073741824" returned: 0 in 1.058s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:57 devstack sudo[91554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:42:57 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:58 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 0 in 0.691s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-231934652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72171668-fcfa-4195-8aff-ab272ca3656c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd48b4a6d684055a7f6411d69187ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:42:57Z,use_quota=True,user_id='097419b3c8ec4909887d09608520e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Creating volume 72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:42:58 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:58 devstack sudo[91558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c 1073741824
Apr 29 08:42:58 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Attempting download of 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume a52ced21-f828-4a3b-a3b1-f29d0b56f951. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c6fe8-1f60-4bd5-ada4-40ef9fd442dc]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:42:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:58 devstack sudo[91560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv
Apr 29 08:42:58 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:59 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv" returned: 0 in 0.790s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:59 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root
Apr 29 08:42:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c 1073741824" returned: 0 in 0.962s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:42:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:42:59 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:42:59 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:42:59 devstack sudo[91567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv
Apr 29 08:42:59 devstack sudo[91567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:00 devstack sudo[91567]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv" returned: 1 in 0.756s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_000942db-1254-4464-b86b-8409e1be6077_nggu1imv' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362f86d-74f2-400b-bd6e-ffdfeb5e9795]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:00 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.730s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3a419e-1699-4491-8400-3eb467002111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72171668-fcfa-4195-8aff-ab272ca3656c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49e4aa-946e-4e73-bd25-fc0e00a10171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Volume volume-72171668-fcfa-4195-8aff-ab272ca3656c (72171668-fcfa-4195-8aff-ab272ca3656c): created successfully
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49e4aa-946e-4e73-bd25-fc0e00a10171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Flow 'volume_create_manager' (aad3acce-e3fe-4c7e-bf8a-639a77248b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b871dcbe-3edf-4397-9a5a-bbb4522209de tempest-SnapshotDependencyTests-1608831661 None] Created volume successfully.
Apr 29 08:43:00 devstack sudo[91574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD
Apr 29 08:43:00 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Creating offline snapshot a5205673-aecd-4efe-aa09-22ae54c26242 of volume 72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8ba02d-e12f-4845-b253-d6462cc691f9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:01 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD" returned: 0 in 0.860s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:01 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] 000942db-1254-4464-b86b-8409e1be6077 was qcow2, converting to raw {{(pid=84102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 08:43:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:01 devstack sudo[91583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:01 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:01 devstack sudo[91582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:01 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:01 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.800s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:01 devstack sudo[91596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 1G
Apr 29 08:43:01 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:02 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 1G" returned: 0 in 1.086s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72171668-fcfa-4195-8aff-ab272ca3656c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:02 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72171668-fcfa-4195-8aff-ab272ca3656c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:02 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:03 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 0 in 2.153s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:03 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_000942db-1254-4464-b86b-8409e1be6077_y9n4qss6devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:03 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Converted 112.00 MB image at 51.98 MB/s
Apr 29 08:43:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:03 devstack sudo[91604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1G
Apr 29 08:43:03 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:03 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72171668-fcfa-4195-8aff-ab272ca3656c -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.762s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:03 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 is being set with open permissions: ugo+rw
Apr 29 08:43:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:03 devstack sudo[91610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:03 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:04 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 1G" returned: 0 in 0.801s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[130b2f5e-7b00-41e9-83ac-f6b3f454e980]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:04 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:04 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:04 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.674s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:04 devstack sudo[91618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info
Apr 29 08:43:04 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:04 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 0 in 0.775s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:05 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:05 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:05 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info" returned: 0 in 0.660s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:05 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info is being set with open permissions: ugo+rw
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:05 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info
Apr 29 08:43:05 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:05 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 1 in 0.848s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Downloaded image 000942db-1254-4464-b86b-8409e1be6077 ((None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}])) to volume a52ced21-f828-4a3b-a3b1-f29d0b56f951 successfully. {{(pid=84102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Temporary image 000942db-1254-4464-b86b-8409e1be6077 for user cd276632f5b442aaba33ba28c6659e5e is deleted. {{(pid=84102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.volume_utils [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Marking volume a52ced21-f828-4a3b-a3b1-f29d0b56f951 as bootable. {{(pid=84102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 08:43:05 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Copying metadata from image 000942db-1254-4464-b86b-8409e1be6077 to a52ced21-f828-4a3b-a3b1-f29d0b56f951. {{(pid=84102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Creating volume glance metadata for volume a52ced21-f828-4a3b-a3b1-f29d0b56f951 backed by image 000942db-1254-4464-b86b-8409e1be6077 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.info" returned: 0 in 0.710s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.819s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c9145b2c-8a33-4ef7-b640-c331cab4300b tempest-SnapshotDependencyTests-1608831661 None] Create snapshot completed successfully
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c401461-8e62-45a8-bb47-c752fcde0561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951', 'volume_size': 1, 'image_id': '000942db-1254-4464-b86b-8409e1be6077', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/000942db-1254-4464-b86b-8409e1be6077', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca042115179c4adfb95ef41c5ae9b85a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '000942db-1254-4464-b86b-8409e1be6077', 'created_at': datetime.datetime(2026, 4, 29, 6, 28, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 6, 28, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/000942db-1254-4464-b86b-8409e1be6077/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x761478d65eb0>}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d13e0-9c50-4077-ba3b-5329f7e8d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:05 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Volume volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 (a52ced21-f828-4a3b-a3b1-f29d0b56f951): created successfully
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d13e0-9c50-4077-ba3b-5329f7e8d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:05 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (73497289-78b8-496a-9b98-38ad56ac7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b5b584b4-4e29-4947-be4f-6f19daece875 tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Flow 'volume_create_manager' (8fd71a57-afc0-4d46-ac49-8eb84a9bf427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fa659f-0518-4a12-be28-3b292a258fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fa659f-0518-4a12-be28-3b292a258fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2345e338-a1f5-47b2-86a2-493276d924a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cd48b4a6d684055a7f6411d69187ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a5205673-aecd-4efe-aa09-22ae54c26242,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:07Z,use_quota=True,user_id='097419b3c8ec4909887d09608520e559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a111a-76cd-458c-b2e2-99b9722271ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03a111a-76cd-458c-b2e2-99b9722271ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18d784d-c417-46dd-a0cb-71bc96cf2b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18d784d-c417-46dd-a0cb-71bc96cf2b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2345e338-a1f5-47b2-86a2-493276d924a2', 'volume_name': 'volume-2345e338-a1f5-47b2-86a2-493276d924a2', 'volume_size': 1, 'snapshot_id': 'a5205673-aecd-4efe-aa09-22ae54c26242'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7ef980-ebe5-4d82-aacd-604397fca247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7ef980-ebe5-4d82-aacd-604397fca247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7df895b-34e1-472b-ade3-cb0f21dd6864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:06 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Volume 2345e338-a1f5-47b2-86a2-493276d924a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2345e338-a1f5-47b2-86a2-493276d924a2', 'volume_size': 1, 'snapshot_id': 'a5205673-aecd-4efe-aa09-22ae54c26242'}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242-2345e338-a1f5-47b2-86a2-493276d924a2" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242-2345e338-a1f5-47b2-86a2-493276d924a2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Creating volume 2345e338-a1f5-47b2-86a2-493276d924a2 from snapshot a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] snapshot: a5205673-aecd-4efe-aa09-22ae54c26242, volume: 2345e338-a1f5-47b2-86a2-493276d924a2,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de53b6e-cc92-44e9-8a31-af71517dc901]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:07 devstack sudo[91633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:07 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (f393192f-890a-4560-a43a-3d4b84fa29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bbc5e-f909-46ba-b0d9-72de344ad773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6bbc5e-f909-46ba-b0d9-72de344ad773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2122473683',display_name='tempest-VolumesGetTest-Volume-1046031009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:07Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968643a-0618-4a79-b201-27a4b107da01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d968643a-0618-4a79-b201-27a4b107da01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec89877-ea3c-482f-a6d9-0177a60c6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec89877-ea3c-482f-a6d9-0177a60c6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6', 'volume_name': 'volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926901d0-568b-4d5c-8f15-1994ba80fb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926901d0-568b-4d5c-8f15-1994ba80fb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a93bec4-8113-4279-aae6-0848312a7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:07 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Volume bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6', 'volume_size': 1}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:07 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.877s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72171668-fcfa-4195-8aff-ab272ca3656c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb826dee-988d-4dfd-b38a-0db90365433b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (50abcb1f-a826-41c3-ad8a-c8dfc7458ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1495314-d9b6-4260-b47b-8a440af65053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:08 devstack sudo[91638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:08 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1495314-d9b6-4260-b47b-8a440af65053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984100707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163383f-ccd4-43ad-9c8a-78d8c7b15b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:08Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e63d9b-cc57-4e24-8dc9-ac4ab3e3a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e63d9b-cc57-4e24-8dc9-ac4ab3e3a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f14d92f-20b0-4043-adcb-147d8427b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f14d92f-20b0-4043-adcb-147d8427b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5163383f-ccd4-43ad-9c8a-78d8c7b15b1b', 'volume_name': 'volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84a372c-acd4-4f82-a20f-0002ca50b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84a372c-acd4-4f82-a20f-0002ca50b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9ba8c1-f5f1-49e1-bbd5-b5c2a04960a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:08 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Volume 5163383f-ccd4-43ad-9c8a-78d8c7b15b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b', 'volume_size': 1}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:08 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:43:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:08 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2
Apr 29 08:43:08 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:13 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2" returned: 0 in 4.482s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:13 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b37cf-ac68-4ded-9a47-c23b27dc04dd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:13 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:13 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:14 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.920s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:43:14 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Converted 1024.00 MB image at 228.39 MB/s
Apr 29 08:43:14 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 is being set with open permissions: ugo+rw
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:14 devstack sudo[91669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2
Apr 29 08:43:14 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:14 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2" returned: 0 in 0.615s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" released by "_copy_volume_from_snapshot" :: held 7.765s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242-2345e338-a1f5-47b2-86a2-493276d924a2" released by "_create_volume_from_snapshot" :: held 7.800s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.817s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.140s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2122473683',display_name='tempest-VolumesGetTest-Volume-1046031009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d793f82d23054983bcb324f6e3f93581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:07Z,use_quota=True,user_id='cd276632f5b442aaba33ba28c6659e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Creating volume bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:14 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:14 devstack sudo[91672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 1073741824
Apr 29 08:43:14 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7df895b-34e1-472b-ade3-cb0f21dd6864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2345e338-a1f5-47b2-86a2-493276d924a2', 'volume_size': 1, 'snapshot_id': 'a5205673-aecd-4efe-aa09-22ae54c26242'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78583eba-f4e0-4573-b0db-206ac47d9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Volume volume-2345e338-a1f5-47b2-86a2-493276d924a2 (2345e338-a1f5-47b2-86a2-493276d924a2): created successfully
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78583eba-f4e0-4573-b0db-206ac47d9369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Flow 'volume_create_manager' (8fd71a57-afc0-4d46-ac49-8eb84a9bf427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-254e4ea8-964f-4ef8-94c6-0bd1cbde71ad tempest-SnapshotDependencyTests-1608831661 None] Created volume successfully.
Apr 29 08:43:15 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 1073741824" returned: 0 in 0.778s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-a5205673-aecd-4efe-aa09-22ae54c26242-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:15 devstack sudo[91677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6
Apr 29 08:43:15 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-a5205673-aecd-4efe-aa09-22ae54c26242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Deleting offline snapshot a5205673-aecd-4efe-aa09-22ae54c26242 of volume 72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] snapshot_file for this snap is: volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01b169-8244-4b14-b33d-fb5513553331]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:15 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:15 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:16 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" returned: 0 in 0.661s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.130s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-984100707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163383f-ccd4-43ad-9c8a-78d8c7b15b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:08Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Creating volume 5163383f-ccd4-43ad-9c8a-78d8c7b15b1b {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:16 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a93bec4-8113-4279-aae6-0848312a7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc7baa6-71b2-42fa-9aad-f4e9186e7c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:16 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b 1073741824
Apr 29 08:43:16 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:16 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Volume volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 (bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6): created successfully
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc7baa6-71b2-42fa-9aad-f4e9186e7c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Flow 'volume_create_manager' (f393192f-890a-4560-a43a-3d4b84fa29dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:16 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b3c5e629-59f3-491a-a60d-b3947e427d3e tempest-VolumesGetTest-992756515 None] Created volume successfully.
Apr 29 08:43:16 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.731s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72171668-fcfa-4195-8aff-ab272ca3656c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc2e28a-212c-45bb-afbe-a73a11de2ea0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:16 devstack sudo[91687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:16 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:16 devstack sudo[91692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:16 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b 1073741824" returned: 0 in 0.785s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b
Apr 29 08:43:17 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.890s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:17 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "cinder-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a3ac5e-e447-4999-bb5d-730f0a500316]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:17 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.827s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:17 devstack sudo[91703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6
Apr 29 08:43:17 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:17 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" returned: 0 in 0.759s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9ba8c1-f5f1-49e1-bbd5-b5c2a04960a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dd5c0b-10cf-414e-9b25-0f40771be5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:17 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Volume volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b (5163383f-ccd4-43ad-9c8a-78d8c7b15b1b): created successfully
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8dd5c0b-10cf-414e-9b25-0f40771be5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (50abcb1f-a826-41c3-ad8a-c8dfc7458ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:17 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-407d3770-f97c-40a3-a3ee-8ffd6ba1e30e tempest-VolumesListAdminTestJSON-1214296362 None] Created volume successfully.
Apr 29 08:43:18 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.870s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:18 devstack sudo[91709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242
Apr 29 08:43:18 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:18 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" returned: 0 in 0.759s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:18 devstack sudo[91714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6
Apr 29 08:43:18 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:18 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c.a5205673-aecd-4efe-aa09-22ae54c26242" returned: 0 in 0.664s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-a5205673-aecd-4efe-aa09-22ae54c26242" released by "_delete_snapshot" :: held 3.269s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" released by "delete_snapshot" :: held 3.297s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:18 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" returned: 0 in 0.644s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:18 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Created reservations ['c580fe9f-c74f-4404-b116-a14ccec4c025', '392b234c-d148-4d5f-865f-c9dabaaa6e6d', '30a9bacf-c92b-44e5-b7d5-a41dd0c13027', 'f72819e8-9c0d-48f1-a9e6-7ea88314ae33'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6" released by "delete_volume" :: held 1.452s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Delete snapshot completed successfully.
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2435b4fc-a805-437d-bdd2-c6d572feddb0 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-a5205673-aecd-4efe-aa09-22ae54c26242-delete_snapshot" released by "delete_snapshot" :: held 3.473s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Created reservations ['c328e2ac-735e-4a4d-a235-b4aade012e93', 'd533d658-949f-42f5-8bee-ee84311b47e7', '7b9ba3aa-9e56-409e-b899-094f1fa6250a', 'c617c746-f9ac-4edf-9535-ee931a68591d'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:19 devstack sudo[91718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:19 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (efa1f13a-8a00-460f-9be5-05180d8a9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b9f92-ad4a-4e75-969a-b659f9f4c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b9f92-ad4a-4e75-969a-b659f9f4c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-488093764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50413793-84c7-45cd-adce-1135da271176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:19Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e899f3e2-135b-44c3-a518-03f6d4aba770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e899f3e2-135b-44c3-a518-03f6d4aba770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0e936a-b7bc-48b3-9777-5577f809ada5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0e936a-b7bc-48b3-9777-5577f809ada5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50413793-84c7-45cd-adce-1135da271176', 'volume_name': 'volume-50413793-84c7-45cd-adce-1135da271176', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57475e83-4f5f-4f64-9938-8aa5c80d12c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57475e83-4f5f-4f64-9938-8aa5c80d12c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea25c5af-94b7-4ce2-82ac-dd1961acc7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:19 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Volume 50413793-84c7-45cd-adce-1135da271176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50413793-84c7-45cd-adce-1135da271176', 'volume_size': 1}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-488093764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50413793-84c7-45cd-adce-1135da271176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:19Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Creating volume 50413793-84c7-45cd-adce-1135da271176 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:19 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:19 devstack sudo[91720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 1073741824
Apr 29 08:43:19 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-a52ced21-f828-4a3b-a3b1-f29d0b56f951-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "cinder-a52ced21-f828-4a3b-a3b1-f29d0b56f951-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:19 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.651s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-72171668-fcfa-4195-8aff-ab272ca3656c-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Acquiring lock "cinder-quobyte-a52ced21-f828-4a3b-a3b1-f29d0b56f951" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-72171668-fcfa-4195-8aff-ab272ca3656c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe2be8ca-6f89-4eb8-b304-a77d28c2bd80 tempest-VolumesGetTest-992756515 None] Lock "cinder-bd0517e9-1321-4f8b-8628-ffc2a9b1e6d6-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-a52ced21-f828-4a3b-a3b1-f29d0b56f951" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc128589-a3ad-411f-83aa-8676b152f645]: (4, 'raw') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f4bbd-e8c6-4b49-bdc2-960ffbd02b00]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack sudo[91726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:20 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:20 devstack sudo[91727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:20 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:20 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 1073741824" returned: 0 in 0.892s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176
Apr 29 08:43:20 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:20 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 0 in 0.748s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.816s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:20 devstack sudo[91739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:20 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:20 devstack sudo[91741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c
Apr 29 08:43:20 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:21 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176" returned: 0 in 0.727s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea25c5af-94b7-4ce2-82ac-dd1961acc7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50413793-84c7-45cd-adce-1135da271176', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc2c04e-69a5-48a0-a728-ef2872810032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Volume volume-50413793-84c7-45cd-adce-1135da271176 (50413793-84c7-45cd-adce-1135da271176): created successfully
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc2c04e-69a5-48a0-a728-ef2872810032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (efa1f13a-8a00-460f-9be5-05180d8a9d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:21 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a0ff59c3-12f9-420e-8166-6034c763a5ea tempest-VolumesListAdminTestJSON-1214296362 None] Created volume successfully.
Apr 29 08:43:21 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 1 in 0.763s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951' failed. Not Retrying. {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:21 devstack sudo[91748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951
Apr 29 08:43:21 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:21 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-72171668-fcfa-4195-8aff-ab272ca3656c" returned: 0 in 0.705s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-72171668-fcfa-4195-8aff-ab272ca3656c" released by "delete_volume" :: held 1.605s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Created reservations ['b403f8d2-a292-4983-864f-790d4ab2f872', 'c8e0c07c-d52a-4c50-961e-a1e3b3f88795', '8b8b0ec5-dbd6-4b24-8ae7-5d9bc36f44d1', '8d919d87-d5e7-479c-86ea-b9deed3d3135'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:21 devstack sudo[91750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:21 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (87eeb2a9-4af0-4e44-ad33-c8d9e7493212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d5819-ea3d-4a49-9128-1bc14a4c93cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a91d5819-ea3d-4a49-9128-1bc14a4c93cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-541089391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3433228-9fe9-41ab-9610-30189745c6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:22Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ef0320-1313-432e-8d2d-f765c0a405eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ef0320-1313-432e-8d2d-f765c0a405eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5aa549-c5f5-4626-b310-4474739afb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5aa549-c5f5-4626-b310-4474739afb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3433228-9fe9-41ab-9610-30189745c6f4', 'volume_name': 'volume-d3433228-9fe9-41ab-9610-30189745c6f4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533df3a4-fcef-4a54-aa4b-13deefe12d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533df3a4-fcef-4a54-aa4b-13deefe12d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd4a5ab-3cad-4975-8a9f-401730f97fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Volume d3433228-9fe9-41ab-9610-30189745c6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3433228-9fe9-41ab-9610-30189745c6f4', 'volume_size': 1}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-541089391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3433228-9fe9-41ab-9610-30189745c6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb068888f20d4d869f148b493e511ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:22Z,use_quota=True,user_id='3ca61ca3ab74452db563cf1dfe384a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Creating volume d3433228-9fe9-41ab-9610-30189745c6f4 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:22 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-2345e338-a1f5-47b2-86a2-493276d924a2-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:22 devstack sudo[91753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 1073741824
Apr 29 08:43:22 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-2345e338-a1f5-47b2-86a2-493276d924a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:22 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a52ced21-f828-4a3b-a3b1-f29d0b56f951" returned: 0 in 0.718s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "cinder-quobyte-a52ced21-f828-4a3b-a3b1-f29d0b56f951" released by "delete_volume" :: held 2.315s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bedeea-5f25-409a-a239-70ff139ffa17]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Created reservations ['30ec808d-b40e-49b9-9f71-329d163b6886', '92714ea3-35ea-4a13-9cc6-49341eb1930c', '006283c0-8ccd-4249-8171-b7fd4baf273c', '95bf30eb-d264-47ab-a6c3-878556b9f960'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:22 devstack sudo[91755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2
Apr 29 08:43:22 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:22 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:22 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:22 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.849s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Deleted volume successfully.
Apr 29 08:43:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9b8730e-c47d-4e66-9f58-7fd2bd136090 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-72171668-fcfa-4195-8aff-ab272ca3656c-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:23 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 1073741824" returned: 0 in 1.036s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:23 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.694s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:23 devstack sudo[91767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4
Apr 29 08:43:23 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Deleted volume successfully.
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-48aedbbc-b1cd-4b99-a4b1-965db75df285 tempest-VolumesGetTest-992756515 None] Lock "cinder-a52ced21-f828-4a3b-a3b1-f29d0b56f951-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:23 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2" returned: 0 in 0.990s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:23 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2
Apr 29 08:43:23 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:23 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4" returned: 0 in 0.716s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd4a5ab-3cad-4975-8a9f-401730f97fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3433228-9fe9-41ab-9610-30189745c6f4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4c674-4fe9-4a66-a1f5-4dd73569b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:23 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Volume volume-d3433228-9fe9-41ab-9610-30189745c6f4 (d3433228-9fe9-41ab-9610-30189745c6f4): created successfully
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4c674-4fe9-4a66-a1f5-4dd73569b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Flow 'volume_create_manager' (87eeb2a9-4af0-4e44-ad33-c8d9e7493212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2345e338-a1f5-47b2-86a2-493276d924a2" returned: 0 in 0.705s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-quobyte-2345e338-a1f5-47b2-86a2-493276d924a2" released by "delete_volume" :: held 1.773s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1289c5aa-7665-410f-9afa-b0ce7892aae4 tempest-VolumesListAdminTestJSON-1214296362 None] Created volume successfully.
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Created reservations ['cf56946c-e893-4370-9b95-874eda455777', '383f3483-858b-4d7c-a94c-c54a90881a8c', '9da0e07c-674c-4718-8885-6227e9d72222', 'e8f372ad-c202-414b-98fa-fbff59a4eb61'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:24 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:24 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:24 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.771s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:24 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Deleted volume successfully.
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aee3c667-e9df-4a1c-9a2f-d5139b607284 tempest-SnapshotDependencyTests-1608831661 None] Lock "cinder-2345e338-a1f5-47b2-86a2-493276d924a2-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Flow 'volume_create_manager' (ada58ae1-acc1-46e2-a400-90f9aa1ce342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6da73d7-f2bd-44ee-a9c0-da20e3d6e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6da73d7-f2bd-44ee-a9c0-da20e3d6e07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc92a0e-fb42-4911-85e4-b7d91640e316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b476d376274d88a9dd9d33996d76d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:25Z,use_quota=True,user_id='84ce23e423af41c69d261878d94feb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0b444-61f5-42e7-a877-03ab34bc3726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0b444-61f5-42e7-a877-03ab34bc3726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8248f8-dd97-47d1-81cb-dcc1518b7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8248f8-dd97-47d1-81cb-dcc1518b7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cc92a0e-fb42-4911-85e4-b7d91640e316', 'volume_name': 'volume-8cc92a0e-fb42-4911-85e4-b7d91640e316', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3caacd17-b740-4fb7-881c-6b4a59d482dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3caacd17-b740-4fb7-881c-6b4a59d482dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed0143b-c5e5-4b77-bae9-ba0f7772aff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Volume 8cc92a0e-fb42-4911-85e4-b7d91640e316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cc92a0e-fb42-4911-85e4-b7d91640e316', 'volume_size': 1}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cc92a0e-fb42-4911-85e4-b7d91640e316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b476d376274d88a9dd9d33996d76d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:25Z,use_quota=True,user_id='84ce23e423af41c69d261878d94feb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Creating volume 8cc92a0e-fb42-4911-85e4-b7d91640e316 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:25 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:25 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 1073741824
Apr 29 08:43:25 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:26 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 1073741824" returned: 0 in 0.999s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:26 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316
Apr 29 08:43:26 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (b986bfa5-22f5-4bf1-bbbb-32a35567bb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b856e38-a170-40af-a50f-682049aeca85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b856e38-a170-40af-a50f-682049aeca85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-163280429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2529ef-7753-4e58-b03f-86e0de3a7b75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:27Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd022c0-2d34-42f3-8966-97de3700ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd022c0-2d34-42f3-8966-97de3700ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbc6324-9df6-4e63-9590-fbf528ccba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbc6324-9df6-4e63-9590-fbf528ccba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2529ef-7753-4e58-b03f-86e0de3a7b75', 'volume_name': 'volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e210a1d8-fa3e-418a-950a-794c2804369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e210a1d8-fa3e-418a-950a-794c2804369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31641e32-6ac1-41e8-8163-c0200d38b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Volume bf2529ef-7753-4e58-b03f-86e0de3a7b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75', 'volume_size': 1}
Apr 29 08:43:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:27 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316" returned: 0 in 0.697s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-163280429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2529ef-7753-4e58-b03f-86e0de3a7b75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:27Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Creating volume bf2529ef-7753-4e58-b03f-86e0de3a7b75 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:27 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:27 devstack sudo[91786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 1073741824
Apr 29 08:43:27 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed0143b-c5e5-4b77-bae9-ba0f7772aff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cc92a0e-fb42-4911-85e4-b7d91640e316', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d99713d-efb6-4b67-90a9-885c8fcff02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:27 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Volume volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 (8cc92a0e-fb42-4911-85e4-b7d91640e316): created successfully
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d99713d-efb6-4b67-90a9-885c8fcff02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Flow 'volume_create_manager' (ada58ae1-acc1-46e2-a400-90f9aa1ce342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-071566f6-f517-4200-87ea-882dd296bd9d tempest-VolumesListAdminTestJSON-1600677197 None] Created volume successfully.
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Acquiring lock "cinder-8cc92a0e-fb42-4911-85e4-b7d91640e316-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "cinder-8cc92a0e-fb42-4911-85e4-b7d91640e316-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Acquiring lock "cinder-quobyte-8cc92a0e-fb42-4911-85e4-b7d91640e316" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "cinder-quobyte-8cc92a0e-fb42-4911-85e4-b7d91640e316" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8ad00-cf7d-472d-9a71-881929a23e8f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-d3433228-9fe9-41ab-9610-30189745c6f4-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-d3433228-9fe9-41ab-9610-30189745c6f4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:27 devstack sudo[91788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316
Apr 29 08:43:27 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-quobyte-d3433228-9fe9-41ab-9610-30189745c6f4" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-d3433228-9fe9-41ab-9610-30189745c6f4" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f375a2-9e79-4a05-ac86-805229061192]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:27 devstack sudo[91793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4
Apr 29 08:43:27 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:28 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 1073741824" returned: 0 in 1.145s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:28 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75
Apr 29 08:43:28 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:28 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316" returned: 0 in 1.043s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:28 devstack sudo[91802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316
Apr 29 08:43:28 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:28 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4" returned: 0 in 1.012s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:28 devstack sudo[91806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4
Apr 29 08:43:28 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75" returned: 0 in 0.679s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:28 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31641e32-6ac1-41e8-8163-c0200d38b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41737bf4-5d71-47bd-a241-d1c2d768a7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:29 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Volume volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 (bf2529ef-7753-4e58-b03f-86e0de3a7b75): created successfully
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41737bf4-5d71-47bd-a241-d1c2d768a7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (b986bfa5-22f5-4bf1-bbbb-32a35567bb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:29 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c792c9b2-f602-465b-a56e-5d1930b3a15d tempest-VolumesListTestJSON-42541522 None] Created volume successfully.
Apr 29 08:43:29 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8cc92a0e-fb42-4911-85e4-b7d91640e316" returned: 0 in 0.816s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "cinder-quobyte-8cc92a0e-fb42-4911-85e4-b7d91640e316" released by "delete_volume" :: held 1.934s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Created reservations ['e5f0a525-932f-4cab-8d4f-7424624ad60a', 'feb1d78a-efad-4ee9-8f81-e77e16403e5a', '7f0f56e0-0b59-4ad2-9cb5-9b9f1575bc60', 'acd9e2f0-4b59-4630-b339-e2e385834497'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:29 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d3433228-9fe9-41ab-9610-30189745c6f4" returned: 0 in 0.786s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-d3433228-9fe9-41ab-9610-30189745c6f4" released by "delete_volume" :: held 1.853s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:29 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:29 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Created reservations ['1f220e8f-16dd-4ccb-ba52-5f5e4876250c', 'df0039e6-d019-42f5-bfb8-21a417f2401a', '9171ecac-0d0d-4ebf-9330-f5b43eb65f55', 'ec19cd40-4687-45c3-be70-5d30edabe1c0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:29 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:29 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-50413793-84c7-45cd-adce-1135da271176-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-50413793-84c7-45cd-adce-1135da271176-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-quobyte-50413793-84c7-45cd-adce-1135da271176" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-50413793-84c7-45cd-adce-1135da271176" acquired by "delete_volume" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[938979bb-e885-4b09-99ec-8c0dc9ed1b92]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:30 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.754s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Deleted volume successfully.
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-df8f1bb8-b64c-4936-a190-1d31f0df8c3f tempest-VolumesListAdminTestJSON-1600677197 None] Lock "cinder-8cc92a0e-fb42-4911-85e4-b7d91640e316-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:30 devstack sudo[91816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176
Apr 29 08:43:30 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:30 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.830s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Deleted volume successfully.
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-35c4a207-af68-4e70-8ad7-d21f5611c6b6 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-d3433228-9fe9-41ab-9610-30189745c6f4-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (ad22bdcc-8a0a-445f-aacf-b90f3b505d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95168361-9d7d-4c3a-9d19-2d9b767769ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95168361-9d7d-4c3a-9d19-2d9b767769ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-75278862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1392694-3323-4557-aa97-3aeb0e6924d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:31Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a7d4fc-1542-4c81-8b19-d9ca76edd217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a7d4fc-1542-4c81-8b19-d9ca76edd217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a6db36-bbe3-4e2a-8238-b276914cbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a6db36-bbe3-4e2a-8238-b276914cbc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1392694-3323-4557-aa97-3aeb0e6924d2', 'volume_name': 'volume-d1392694-3323-4557-aa97-3aeb0e6924d2', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f63593-159d-438d-a0de-466e02f5d61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f63593-159d-438d-a0de-466e02f5d61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cf0078-1532-4ada-a1dc-d67b53b02511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:30 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Volume d1392694-3323-4557-aa97-3aeb0e6924d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1392694-3323-4557-aa97-3aeb0e6924d2', 'volume_size': 1}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-75278862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1392694-3323-4557-aa97-3aeb0e6924d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:31Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Creating volume d1392694-3323-4557-aa97-3aeb0e6924d2 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:30 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:31 devstack sudo[91820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 1073741824
Apr 29 08:43:31 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:31 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176" returned: 0 in 0.811s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:31 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176
Apr 29 08:43:31 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:31 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 1073741824" returned: 0 in 0.880s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:31 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-50413793-84c7-45cd-adce-1135da271176" returned: 0 in 0.713s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-50413793-84c7-45cd-adce-1135da271176" released by "delete_volume" :: held 1.605s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:31 devstack sudo[91832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2
Apr 29 08:43:31 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:31 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Created reservations ['8ed37f3c-b717-4e61-9c30-6fcd39f0ba4c', 'c03eec00-fd39-4e27-a8e4-cd71e0ea1ce9', '7d4dc883-4b1e-4725-bc8e-6ce3ee57ddd6', 'd0d0d785-5039-4977-b671-4df66ab11067'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:32 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:32 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "cinder-quobyte-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb8257-9a9d-4bdb-abf0-1e8aeeff3da6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:32 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2" returned: 0 in 0.819s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01cf0078-1532-4ada-a1dc-d67b53b02511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1392694-3323-4557-aa97-3aeb0e6924d2', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c588e2-83fd-4ce3-819d-b64ddb5d2458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:32 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Volume volume-d1392694-3323-4557-aa97-3aeb0e6924d2 (d1392694-3323-4557-aa97-3aeb0e6924d2): created successfully
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c588e2-83fd-4ce3-819d-b64ddb5d2458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (ad22bdcc-8a0a-445f-aacf-b90f3b505d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-929fc057-283b-45ec-aadc-52990d70474b tempest-VolumesListTestJSON-42541522 None] Created volume successfully.
Apr 29 08:43:32 devstack sudo[91839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b
Apr 29 08:43:32 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:32 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.740s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Deleted volume successfully.
Apr 29 08:43:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-cb59ae2b-c06c-4632-8b44-2046046125c7 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-50413793-84c7-45cd-adce-1135da271176-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:33 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (e4764c57-cfc6-4839-b479-e15011363c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5796aca9-da5f-4892-9c4c-f4dc39679f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" returned: 0 in 0.939s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5796aca9-da5f-4892-9c4c-f4dc39679f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-5358379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61b641d-0244-487f-b5ed-b58e4d3435ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:34Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack sudo[91845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a12d0f4-bdda-4cc6-a473-0c4167dffe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a12d0f4-bdda-4cc6-a473-0c4167dffe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8057e3-a8d1-41c7-a79b-7de5687f518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8057e3-a8d1-41c7-a79b-7de5687f518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61b641d-0244-487f-b5ed-b58e4d3435ef', 'volume_name': 'volume-d61b641d-0244-487f-b5ed-b58e4d3435ef', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01c00a1-2f46-4135-90ad-63769ff45c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01c00a1-2f46-4135-90ad-63769ff45c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9070b555-ae76-41bc-b83b-905b592a76d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:33 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Volume d61b641d-0244-487f-b5ed-b58e4d3435ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61b641d-0244-487f-b5ed-b58e4d3435ef', 'volume_size': 1}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-5358379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61b641d-0244-487f-b5ed-b58e4d3435ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fd0176ba61d47d29fbf55d2388aa45b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:34Z,use_quota=True,user_id='bc4fe1bb6f764062b5b96aaffcd25445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Creating volume d61b641d-0244-487f-b5ed-b58e4d3435ef {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:33 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:33 devstack sudo[91847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef 1073741824
Apr 29 08:43:33 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:34 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" returned: 0 in 0.677s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-quobyte-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b" released by "delete_volume" :: held 1.676s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Created reservations ['0c867c56-77c9-4fd5-9dbc-c64b96fe8610', '5d2d312f-286e-4736-8fe9-a72394e62956', 'f70f57ee-2604-4507-8ae3-9286caeed6e2', 'ceb4cca9-c9a3-466a-b5db-80ddde9ebfd3'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:34 devstack sudo[91854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:34 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:34 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef 1073741824" returned: 0 in 0.938s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:34 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef
Apr 29 08:43:34 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:35 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.678s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Deleted volume successfully.
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-7f9ad990-8ac5-4de5-8030-31877123e949 tempest-VolumesListAdminTestJSON-1214296362 None] Lock "cinder-5163383f-ccd4-43ad-9c8a-78d8c7b15b1b-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:35 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef" returned: 0 in 0.696s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9070b555-ae76-41bc-b83b-905b592a76d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61b641d-0244-487f-b5ed-b58e4d3435ef', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a5e16c-65aa-4083-9991-331cfc409f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:35 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Volume volume-d61b641d-0244-487f-b5ed-b58e4d3435ef (d61b641d-0244-487f-b5ed-b58e4d3435ef): created successfully
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a5e16c-65aa-4083-9991-331cfc409f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Flow 'volume_create_manager' (e4764c57-cfc6-4839-b479-e15011363c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a68ce95c-9432-49a3-b5d3-0ada4f1b6f22 tempest-VolumesListTestJSON-42541522 None] Created volume successfully.
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-d61b641d-0244-487f-b5ed-b58e4d3435ef-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-d61b641d-0244-487f-b5ed-b58e4d3435ef-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-quobyte-d61b641d-0244-487f-b5ed-b58e4d3435ef" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-d61b641d-0244-487f-b5ed-b58e4d3435ef" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17545c50-0029-477f-9615-36b51b110a31]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:37 devstack sudo[91860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef
Apr 29 08:43:37 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:38 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef" returned: 0 in 0.794s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:38 devstack sudo[91865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef
Apr 29 08:43:38 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=156,cinder:SELECT=123,cinder:INSERT=37,cinder:DELETE=13 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Flow 'volume_create_manager' (619058cb-d62f-49e7-8eb6-3f141809c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83b54dd-8c7a-42b7-aafc-96297c7a773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:39 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83b54dd-8c7a-42b7-aafc-96297c7a773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1452079857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8d89f7b93e4af4839a0777c96d147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:39Z,use_quota=True,user_id='373160de418940b09a126f1b7fec54de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225a2b04-2ee2-4acf-8584-ad788fd0a3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225a2b04-2ee2-4acf-8584-ad788fd0a3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5563c6-8d4d-4c77-a9a5-461bed074dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5563c6-8d4d-4c77-a9a5-461bed074dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a', 'volume_name': 'volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee776d-3f21-45dc-82ef-90e1c274bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ee776d-3f21-45dc-82ef-90e1c274bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf9cb9-751e-4173-83d6-e4d92fee26f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:39 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Volume bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a', 'volume_size': 1}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1452079857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8d89f7b93e4af4839a0777c96d147b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:39Z,use_quota=True,user_id='373160de418940b09a126f1b7fec54de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Creating volume bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:39 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d61b641d-0244-487f-b5ed-b58e4d3435ef" returned: 0 in 0.778s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:39 devstack sudo[91868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a 1073741824
Apr 29 08:43:39 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-d61b641d-0244-487f-b5ed-b58e4d3435ef" released by "delete_volume" :: held 1.645s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Created reservations ['86fccfca-e28b-4835-9cb2-d7b5a8f1cced', '1d0c291e-1a9a-4995-98cd-3a6f092144b1', 'bb89309e-ea34-490f-af6b-be04a9f6b1fb', '4772ff48-2c9f-403f-8186-078b2dab113a'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:39 devstack sudo[91870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:39 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-d1392694-3323-4557-aa97-3aeb0e6924d2-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-d1392694-3323-4557-aa97-3aeb0e6924d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-quobyte-d1392694-3323-4557-aa97-3aeb0e6924d2" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-d1392694-3323-4557-aa97-3aeb0e6924d2" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bab9c4c-f473-47f6-82db-0eb9e32527ad]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:40 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.666s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Deleted volume successfully.
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-04f66b45-cccf-413c-97a8-cdd392eb7c0e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-d61b641d-0244-487f-b5ed-b58e4d3435ef-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:40 devstack sudo[91877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2
Apr 29 08:43:40 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:40 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a 1073741824" returned: 0 in 0.933s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:40 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a
Apr 29 08:43:40 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:40 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2" returned: 0 in 0.717s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:40 devstack sudo[91886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2
Apr 29 08:43:40 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:40 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" returned: 0 in 0.604s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf9cb9-751e-4173-83d6-e4d92fee26f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601f111c-d184-4836-9c8d-f1350d3a8f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=168,cinder:SELECT=107,cinder:INSERT=51,cinder:DELETE=17 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:43:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Volume volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a (bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a): created successfully
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601f111c-d184-4836-9c8d-f1350d3a8f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Flow 'volume_create_manager' (619058cb-d62f-49e7-8eb6-3f141809c416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:41 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5a45f5f0-1d9e-4005-8855-29be2ee74b84 tempest-VolumesMetadataTest-945967109 None] Created volume successfully.
Apr 29 08:43:41 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d1392694-3323-4557-aa97-3aeb0e6924d2" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-d1392694-3323-4557-aa97-3aeb0e6924d2" released by "delete_volume" :: held 1.416s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Created reservations ['f656f784-c1dc-4a9b-afe4-48358d628246', '2b26300b-dd11-4585-8bd7-44cf73aad199', 'e340da1f-fe14-4da8-8331-9014d8d3cc19', '868ef036-aab2-4b2b-946f-9f2df4b3e6fa'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:41 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:41 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Acquiring lock "cinder-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "cinder-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Acquiring lock "cinder-quobyte-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "cinder-quobyte-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc2ee4-eefa-45fb-bffb-25fe4cbbaade]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:42 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.706s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Deleted volume successfully.
Apr 29 08:43:42 devstack sudo[91892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a
Apr 29 08:43:42 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1fc3060c-ee99-458a-8d2a-4cd312597d4e tempest-VolumesListTestJSON-42541522 None] Lock "cinder-d1392694-3323-4557-aa97-3aeb0e6924d2-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-bf2529ef-7753-4e58-b03f-86e0de3a7b75-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "cinder-bf2529ef-7753-4e58-b03f-86e0de3a7b75-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Acquiring lock "cinder-quobyte-bf2529ef-7753-4e58-b03f-86e0de3a7b75" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-bf2529ef-7753-4e58-b03f-86e0de3a7b75" acquired by "delete_volume" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8bcbce-ef7d-45ad-9ad2-c660e1f0fd92]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:42 devstack sudo[91894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75
Apr 29 08:43:42 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:43 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" returned: 0 in 0.837s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:43 devstack sudo[91900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a
Apr 29 08:43:43 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:43 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:43 devstack sudo[91905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75
Apr 29 08:43:43 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:43 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" returned: 0 in 0.716s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "cinder-quobyte-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a" released by "delete_volume" :: held 1.607s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Created reservations ['3d0faf2d-eda4-4eac-83cd-9ee77cf6c2d7', '4b094d88-41c9-4ee2-addf-8cafbc8a704f', '568bdfaf-e338-4865-a426-eb1dbcc4b102', 'be25df55-d57a-4b87-929c-fc9c4b2b9397'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:43 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bf2529ef-7753-4e58-b03f-86e0de3a7b75" returned: 0 in 0.605s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "cinder-quobyte-bf2529ef-7753-4e58-b03f-86e0de3a7b75" released by "delete_volume" :: held 1.398s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Created reservations ['d571541c-76dc-4e06-aa47-df7741854bd9', '4722c145-f3ac-4558-a800-a41db8608796', 'efa7650c-6029-47a4-96d9-e107ff9159fc', 'd06fe724-7a4d-4edb-b420-6de2416c9114'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:43 devstack sudo[91909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:43 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:44 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:44 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:44 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.668s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Deleted volume successfully.
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fbe307a2-6414-41bd-bba9-a0db069129b6 tempest-VolumesMetadataTest-945967109 None] Lock "cinder-bd62c04e-f19e-42bc-a5c8-8cf0ec83e07a-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:44 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.716s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Deleted volume successfully.
Apr 29 08:43:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9d978fa5-086b-4341-b668-33873555702d tempest-VolumesListTestJSON-42541522 None] Lock "cinder-bf2529ef-7753-4e58-b03f-86e0de3a7b75-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Flow 'volume_create_manager' (2365f317-3d50-4b07-b885-3e63c3facba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0dd2472-a306-49ae-9592-c14af508ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0dd2472-a306-49ae-9592-c14af508ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1784854831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100cb5af-c947-4741-bb62-9dca7bea497a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfd6015b953480cab4138df6a4dfb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:49Z,use_quota=True,user_id='575bfd2ef6374cb69f51a8df35d7b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b98c2f-17a6-4cc0-97c9-51b20429f60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b98c2f-17a6-4cc0-97c9-51b20429f60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7c127a-4850-4b1d-9f57-b4109655702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7c127a-4850-4b1d-9f57-b4109655702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100cb5af-c947-4741-bb62-9dca7bea497a', 'volume_name': 'volume-100cb5af-c947-4741-bb62-9dca7bea497a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09acb9b-32ec-48d1-83aa-f21239155bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09acb9b-32ec-48d1-83aa-f21239155bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7b6121-cab9-49cb-901b-a57b39b11713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Volume 100cb5af-c947-4741-bb62-9dca7bea497a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100cb5af-c947-4741-bb62-9dca7bea497a', 'volume_size': 1}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1784854831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100cb5af-c947-4741-bb62-9dca7bea497a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfd6015b953480cab4138df6a4dfb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:49Z,use_quota=True,user_id='575bfd2ef6374cb69f51a8df35d7b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Creating volume 100cb5af-c947-4741-bb62-9dca7bea497a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:49 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:49 devstack sudo[91917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a 1073741824
Apr 29 08:43:49 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:50 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a 1073741824" returned: 0 in 0.879s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:50 devstack sudo[91923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a
Apr 29 08:43:50 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:50 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a" returned: 0 in 0.615s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7b6121-cab9-49cb-901b-a57b39b11713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100cb5af-c947-4741-bb62-9dca7bea497a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11717153-6e58-47f1-8d80-07dd74ebc434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:51 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Volume volume-100cb5af-c947-4741-bb62-9dca7bea497a (100cb5af-c947-4741-bb62-9dca7bea497a): created successfully
Apr 29 08:43:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11717153-6e58-47f1-8d80-07dd74ebc434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:51 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Flow 'volume_create_manager' (2365f317-3d50-4b07-b885-3e63c3facba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fa791e79-f91d-4e39-b5d3-1bba67caed03 tempest-VolumesTransfersV357Test-1358726041 None] Created volume successfully.
Apr 29 08:43:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3d2aba39-4fc2-4ea8-bb84-ab0e2913252a tempest-VolumesTransfersV357Test-1262426785 None] Transfer volume completed successfully.
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "cinder-100cb5af-c947-4741-bb62-9dca7bea497a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-100cb5af-c947-4741-bb62-9dca7bea497a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "cinder-quobyte-100cb5af-c947-4741-bb62-9dca7bea497a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-quobyte-100cb5af-c947-4741-bb62-9dca7bea497a" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b196f-997a-43d0-b023-ca8a9cfff4ac]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:53 devstack sudo[91929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a
Apr 29 08:43:53 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:54 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a" returned: 0 in 0.755s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:54 devstack sudo[91934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a
Apr 29 08:43:54 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:54 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-100cb5af-c947-4741-bb62-9dca7bea497a" returned: 0 in 0.652s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-quobyte-100cb5af-c947-4741-bb62-9dca7bea497a" released by "delete_volume" :: held 1.455s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Created reservations ['74b72762-1071-4934-8c8b-af0ed1faa62c', '8f0ffca4-20fa-4ecc-a073-49c2af221b89', 'd251ff7b-d761-4c6a-a60f-d8d57cca2443', '66caa79a-72ea-4611-b0b5-f31b635505db'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:54 devstack sudo[91937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:43:54 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:55 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.743s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:55 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:43:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Deleted volume successfully.
Apr 29 08:43:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8cb6bf3f-d565-4ea5-afbd-aa33a279b559 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-100cb5af-c947-4741-bb62-9dca7bea497a-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Flow 'volume_create_manager' (691265b8-f795-4765-89c9-fa874cbd8e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9558273c-6e4d-4170-8b25-e915518142d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9558273c-6e4d-4170-8b25-e915518142d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-552804969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697314c6-3df6-4241-bacc-22f05e61dddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfd6015b953480cab4138df6a4dfb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:56Z,use_quota=True,user_id='575bfd2ef6374cb69f51a8df35d7b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fad221-8a65-4c14-bbbd-9dad74897e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33fad221-8a65-4c14-bbbd-9dad74897e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f5fb9-b39a-4491-89dc-d7a0333d519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a77f5fb9-b39a-4491-89dc-d7a0333d519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697314c6-3df6-4241-bacc-22f05e61dddc', 'volume_name': 'volume-697314c6-3df6-4241-bacc-22f05e61dddc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10652698-62b8-4a93-a837-a2eaaea2cf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10652698-62b8-4a93-a837-a2eaaea2cf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be23c51-9f1c-4117-a0ca-4c0c817c982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:56 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Volume 697314c6-3df6-4241-bacc-22f05e61dddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697314c6-3df6-4241-bacc-22f05e61dddc', 'volume_size': 1}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-552804969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697314c6-3df6-4241-bacc-22f05e61dddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dfd6015b953480cab4138df6a4dfb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:56Z,use_quota=True,user_id='575bfd2ef6374cb69f51a8df35d7b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Creating volume 697314c6-3df6-4241-bacc-22f05e61dddc {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:56 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:56 devstack sudo[91941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc 1073741824
Apr 29 08:43:56 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:57 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc 1073741824" returned: 0 in 0.901s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:57 devstack sudo[91947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc
Apr 29 08:43:57 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:57 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc" returned: 0 in 0.649s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be23c51-9f1c-4117-a0ca-4c0c817c982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697314c6-3df6-4241-bacc-22f05e61dddc', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6ff923-4b29-4310-b66b-d5c4172ed994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Volume volume-697314c6-3df6-4241-bacc-22f05e61dddc (697314c6-3df6-4241-bacc-22f05e61dddc): created successfully
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6ff923-4b29-4310-b66b-d5c4172ed994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Flow 'volume_create_manager' (691265b8-f795-4765-89c9-fa874cbd8e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:57 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-07c79b70-872c-4c97-9cf9-d17dbb761f30 tempest-VolumesTransfersV357Test-1358726041 None] Created volume successfully.
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "cinder-697314c6-3df6-4241-bacc-22f05e61dddc-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-697314c6-3df6-4241-bacc-22f05e61dddc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "cinder-quobyte-697314c6-3df6-4241-bacc-22f05e61dddc" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-quobyte-697314c6-3df6-4241-bacc-22f05e61dddc" acquired by "delete_volume" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[52452761-2ba5-408a-ba5c-fb4ff00c5c4b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:43:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:58 devstack sudo[91986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc
Apr 29 08:43:58 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (bb4ce1ac-d6cd-4afb-8c87-999c6ebf5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af2865e-3825-4c0e-b41e-aecdfc09961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af2865e-3825-4c0e-b41e-aecdfc09961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-592586362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e119cc-751d-4992-964c-21259fac55e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:59Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3d3757-877c-4b85-ac16-f4366ae56215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3d3757-877c-4b85-ac16-f4366ae56215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefb185d-a065-437c-b1d7-968d00ca2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefb185d-a065-437c-b1d7-968d00ca2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e119cc-751d-4992-964c-21259fac55e4', 'volume_name': 'volume-18e119cc-751d-4992-964c-21259fac55e4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14522897-0c42-4621-ab09-12f88d271c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14522897-0c42-4621-ab09-12f88d271c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b3dd27-def9-4404-b6ca-a0da23f9de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:43:59 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Volume 18e119cc-751d-4992-964c-21259fac55e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e119cc-751d-4992-964c-21259fac55e4', 'volume_size': 1}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-592586362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e119cc-751d-4992-964c-21259fac55e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:43:59Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Creating volume 18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:43:59 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:59 devstack sudo[91988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 1073741824
Apr 29 08:43:59 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:43:59 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc" returned: 0 in 0.792s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:43:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:43:59 devstack sudo[91993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc
Apr 29 08:43:59 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:00 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 1073741824" returned: 0 in 0.811s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:00 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4
Apr 29 08:44:00 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:00 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-697314c6-3df6-4241-bacc-22f05e61dddc" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-quobyte-697314c6-3df6-4241-bacc-22f05e61dddc" released by "delete_volume" :: held 1.530s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Created reservations ['453365d2-f655-4dd0-a39d-baabf1d0216b', '07f16c2f-db12-463e-b28f-7e6eed3e4b21', '171b7cf6-b945-4a37-88fc-4f9ee7556f86', 'f4314cd1-95c5-473c-a9c1-b8788fef26b1'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:00 devstack sudo[92001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:00 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:00 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4" returned: 0 in 0.651s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b3dd27-def9-4404-b6ca-a0da23f9de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e119cc-751d-4992-964c-21259fac55e4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bcbbfd-b672-4410-848c-84efef387bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:00 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Volume volume-18e119cc-751d-4992-964c-21259fac55e4 (18e119cc-751d-4992-964c-21259fac55e4): created successfully
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07bcbbfd-b672-4410-848c-84efef387bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:00 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (bb4ce1ac-d6cd-4afb-8c87-999c6ebf5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-297e0487-9bcb-4bde-a4b9-23236fdfe33d tempest-VolumesSnapshotTestJSON-1872334576 None] Created volume successfully.
Apr 29 08:44:01 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.647s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:01 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Deleted volume successfully.
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4cc72dd7-191e-44a3-8c47-404c677ae005 tempest-VolumesTransfersV357Test-417890804 None] Lock "cinder-697314c6-3df6-4241-bacc-22f05e61dddc-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating offline snapshot 5081a570-8bbb-4194-a35e-1782abd7d80b of volume 18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[426c36fb-f763-4a6a-9bc5-cd79554243a0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:01 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4
Apr 29 08:44:01 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:02 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4" returned: 0 in 0.758s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:02 devstack sudo[92011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b 1G
Apr 29 08:44:02 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:03 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b 1G" returned: 0 in 0.845s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e119cc-751d-4992-964c-21259fac55e4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:03 devstack sudo[92017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e119cc-751d-4992-964c-21259fac55e4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b
Apr 29 08:44:03 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:03 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18e119cc-751d-4992-964c-21259fac55e4 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b" returned: 0 in 0.777s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:03 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b is being set with open permissions: ugo+rw
Apr 29 08:44:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:04 devstack sudo[92022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b
Apr 29 08:44:04 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:04 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b" returned: 0 in 0.660s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:04 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info
Apr 29 08:44:04 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:05 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info" returned: 0 in 0.671s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:05 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info is being set with open permissions: ugo+rw
Apr 29 08:44:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:05 devstack sudo[92028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info
Apr 29 08:44:05 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:06 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.info" returned: 0 in 0.664s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-69db52b8-d725-4aba-8096-c1b3502c6470 tempest-VolumesSnapshotTestJSON-1872334576 None] Create snapshot completed successfully
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Flow 'volume_create_manager' (9786afdb-bd35-44cb-a359-9911a03e0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b801f5d-0f07-4bd5-8123-f4277165fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b801f5d-0f07-4bd5-8123-f4277165fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1884678868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94329589-73d6-4d19-bc96-06629f18bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff92f968d24136bce2117b11c603d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:07Z,use_quota=True,user_id='71bad24277924cf8bef9fe5714d9b021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d506ac7-25e0-4e68-8166-33567ab37031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d506ac7-25e0-4e68-8166-33567ab37031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8274892-26cd-4083-8d81-37262678710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8274892-26cd-4083-8d81-37262678710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94329589-73d6-4d19-bc96-06629f18bec1', 'volume_name': 'volume-94329589-73d6-4d19-bc96-06629f18bec1', 'volume_size': 2}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86d4c63-0908-4297-b7d4-a25b04804ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86d4c63-0908-4297-b7d4-a25b04804ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f58f4b-7e16-4e6b-9e13-87f8652ca429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:06 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Volume 94329589-73d6-4d19-bc96-06629f18bec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94329589-73d6-4d19-bc96-06629f18bec1', 'volume_size': 2}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1884678868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94329589-73d6-4d19-bc96-06629f18bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfff92f968d24136bce2117b11c603d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:07Z,use_quota=True,user_id='71bad24277924cf8bef9fe5714d9b021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Creating volume 94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:06 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 2147483648 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:06 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 2147483648
Apr 29 08:44:06 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-5081a570-8bbb-4194-a35e-1782abd7d80b-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-5081a570-8bbb-4194-a35e-1782abd7d80b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-5081a570-8bbb-4194-a35e-1782abd7d80b" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-5081a570-8bbb-4194-a35e-1782abd7d80b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Deleting offline snapshot 5081a570-8bbb-4194-a35e-1782abd7d80b of volume 18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] snapshot_file for this snap is: volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff68f7-cd0b-47ff-93a9-9f89a3f63985]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:07 devstack sudo[92033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b
Apr 29 08:44:07 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:07 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 2147483648" returned: 0 in 0.906s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:07 devstack sudo[92042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1
Apr 29 08:44:07 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:07 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b" returned: 0 in 0.771s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18e119cc-751d-4992-964c-21259fac55e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87814a6-520a-42aa-8d67-c6bdcca3e4f7]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:07 devstack sudo[92044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4
Apr 29 08:44:07 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:08 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1" returned: 0 in 0.652s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f58f4b-7e16-4e6b-9e13-87f8652ca429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94329589-73d6-4d19-bc96-06629f18bec1', 'volume_size': 2}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0c397e-89a7-4838-848e-7309985480ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:08 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Volume volume-94329589-73d6-4d19-bc96-06629f18bec1 (94329589-73d6-4d19-bc96-06629f18bec1): created successfully
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0c397e-89a7-4838-848e-7309985480ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Flow 'volume_create_manager' (9786afdb-bd35-44cb-a359-9911a03e0823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2fd5bed3-89fb-48ab-8ec2-b1daf037e1cd tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Created volume successfully.
Apr 29 08:44:08 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4" returned: 0 in 0.742s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:08 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b
Apr 29 08:44:08 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Creating offline snapshot 60144ca9-69ea-44f0-95f5-487dcf9dd669 of volume 94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b857d04-0ee4-45e5-b752-c141c7bf0990]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:09 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1
Apr 29 08:44:09 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b" returned: 0 in 0.726s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:09 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b
Apr 29 08:44:09 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1" returned: 0 in 0.762s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 2G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:09 devstack sudo[92063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 2G
Apr 29 08:44:09 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:09 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4.5081a570-8bbb-4194-a35e-1782abd7d80b" returned: 0 in 0.611s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-5081a570-8bbb-4194-a35e-1782abd7d80b" released by "_delete_snapshot" :: held 2.999s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" released by "delete_snapshot" :: held 3.024s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['18313ce2-2c7c-4288-a938-522339c6917d', '9059bf94-5964-45cb-9020-1b162d385a84', 'f40610fa-fb67-4cb4-808d-1a8e02c1b5a5', '90b59743-96ee-46e5-aac0-2f3c470d8759'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:10 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Delete snapshot completed successfully.
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-544b9eb3-c5d4-45cb-80cf-12d791f5cf59 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-5081a570-8bbb-4194-a35e-1782abd7d80b-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:10 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 2G" returned: 0 in 0.805s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94329589-73d6-4d19-bc96-06629f18bec1 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:10 devstack sudo[92069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94329589-73d6-4d19-bc96-06629f18bec1 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669
Apr 29 08:44:10 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:11 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94329589-73d6-4d19-bc96-06629f18bec1 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669" returned: 0 in 0.662s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:11 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 is being set with open permissions: ugo+rw
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:11 devstack sudo[92074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669
Apr 29 08:44:11 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (1acb207f-a604-428f-8f4b-2d7fc1f8c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e6113-5d4c-4821-9a5a-108d65ffe6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580e6113-5d4c-4821-9a5a-108d65ffe6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-992061696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255189f-7a28-47fc-a8f1-57ec9f9860f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:12Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e9d02-b4d8-44ef-832d-4cb0352e3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738e9d02-b4d8-44ef-832d-4cb0352e3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d2e544-c9ae-4aba-9cc3-a9686758cc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d2e544-c9ae-4aba-9cc3-a9686758cc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3255189f-7a28-47fc-a8f1-57ec9f9860f7', 'volume_name': 'volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df8b730-dc91-477e-8a2c-4ce25a07269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df8b730-dc91-477e-8a2c-4ce25a07269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e8a4d5-6f07-402a-a2c6-ffc3fab75868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume 3255189f-7a28-47fc-a8f1-57ec9f9860f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7', 'volume_size': 1}
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:11 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669" returned: 0 in 0.666s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:12 devstack sudo[92077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info
Apr 29 08:44:12 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:12 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info" returned: 0 in 0.639s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:12 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info is being set with open permissions: ugo+rw
Apr 29 08:44:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:12 devstack sudo[92086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info
Apr 29 08:44:12 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:13 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.info" returned: 0 in 0.629s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.609s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-992061696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255189f-7a28-47fc-a8f1-57ec9f9860f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:12Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating volume 3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:13 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:13 devstack sudo[92089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 1073741824
Apr 29 08:44:13 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:13 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-36811d6a-096f-4e97-8d70-febf2fe5da45 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Create snapshot completed successfully
Apr 29 08:44:14 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 1073741824" returned: 0 in 0.772s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:14 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:14 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "cinder-60144ca9-69ea-44f0-95f5-487dcf9dd669-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-60144ca9-69ea-44f0-95f5-487dcf9dd669-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "cinder-quobyte-60144ca9-69ea-44f0-95f5-487dcf9dd669" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-60144ca9-69ea-44f0-95f5-487dcf9dd669" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Deleting offline snapshot 60144ca9-69ea-44f0-95f5-487dcf9dd669 of volume 94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] snapshot_file for this snap is: volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[696655be-8610-4ea0-b3b0-14dc2ccd67bf]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:14 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669
Apr 29 08:44:14 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:14 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.623s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e8a4d5-6f07-402a-a2c6-ffc3fab75868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af08740-1800-4ce2-90a2-7cd5afcecb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 (3255189f-7a28-47fc-a8f1-57ec9f9860f7): created successfully
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af08740-1800-4ce2-90a2-7cd5afcecb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (1acb207f-a604-428f-8f4b-2d7fc1f8c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cc486af2-80c5-499c-a309-0484acf92835 tempest-VolumesSnapshotTestJSON-1872334576 None] Created volume successfully.
Apr 29 08:44:15 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669" returned: 0 in 0.722s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94329589-73d6-4d19-bc96-06629f18bec1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207350e-ffb2-4d53-96f2-03d82b53caf6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:15 devstack sudo[92102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1
Apr 29 08:44:15 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:15 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1" returned: 0 in 0.701s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:15 devstack sudo[92107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669
Apr 29 08:44:15 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating offline snapshot de96bbcb-2d80-4307-86e3-3d4603ec3033 of volume 3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5278c2-31ae-4c40-81c7-13b62841cb12]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:16 devstack sudo[92109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:16 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:16 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669" returned: 0 in 0.737s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:16 devstack sudo[92114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669
Apr 29 08:44:16 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:16 devstack sudo[92119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:16 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:16 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.788s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:16 devstack sudo[92121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 1G
Apr 29 08:44:16 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:17 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1.60144ca9-69ea-44f0-95f5-487dcf9dd669" returned: 0 in 0.615s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-60144ca9-69ea-44f0-95f5-487dcf9dd669" released by "_delete_snapshot" :: held 2.908s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" released by "delete_snapshot" :: held 2.934s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Created reservations ['0d4b4514-6438-49b3-8b09-06d51644fa18', 'ce4f5deb-d049-4c3f-9a6d-7bff68b9d432', '19ccfb44-78c8-4fec-8d04-1f11eeeeb659', '5db5acd0-6afc-4e6a-a935-74934926c53b'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:17 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Delete snapshot completed successfully.
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397db5c0-3598-4f6e-ace2-49986387d8d3 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-60144ca9-69ea-44f0-95f5-487dcf9dd669-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:17 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.681s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "cinder-94329589-73d6-4d19-bc96-06629f18bec1-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-94329589-73d6-4d19-bc96-06629f18bec1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[98efc096-49ea-45b1-a004-70289e81874d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:17 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 1G" returned: 0 in 0.899s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:17 devstack sudo[92130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:17 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:17 devstack sudo[92129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1
Apr 29 08:44:17 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:18 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.671s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:18 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 is being set with open permissions: ugo+rw
Apr 29 08:44:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:18 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:18 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:18 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1" returned: 0 in 0.800s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:18 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1
Apr 29 08:44:18 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:19 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.613s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:19 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info
Apr 29 08:44:19 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:19 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-94329589-73d6-4d19-bc96-06629f18bec1" returned: 0 in 0.636s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-quobyte-94329589-73d6-4d19-bc96-06629f18bec1" released by "delete_volume" :: held 1.502s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Created reservations ['150ab01f-6ce8-4bb3-ab3e-c2317df19a2e', '74df554d-0b73-4a16-a3a1-ae0f6b8e4808', 'df175101-644f-4ef6-a57a-a9087fa9539a', '26d21af1-6525-4747-9af4-662cda34545e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:19 devstack sudo[92147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:19 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:19 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:19 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info is being set with open permissions: ugo+rw
Apr 29 08:44:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:19 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info
Apr 29 08:44:19 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:20 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.713s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:20 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:20 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Deleted volume successfully.
Apr 29 08:44:20 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-67a2c9d1-dc7f-4de7-8124-101a3fc04826 tempest-VolumesSnapshotNegativeTestJSON-71832026 None] Lock "cinder-94329589-73d6-4d19-bc96-06629f18bec1-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:20 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.info" returned: 0 in 0.644s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:20 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-552c070c-47ee-4148-b356-3840a0445e63 tempest-VolumesSnapshotTestJSON-1872334576 None] Create snapshot completed successfully
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (9f4a740e-e2ad-41ae-a923-1aa70a2d34fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc12e4-4d54-4db6-bc21-32f367601706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc12e4-4d54-4db6-bc21-32f367601706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1773374150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0397ad5-df90-4df8-8cd1-58267b8906c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=de96bbcb-2d80-4307-86e3-3d4603ec3033,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:22Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b990e8-7043-40ca-9022-ec234246ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b990e8-7043-40ca-9022-ec234246ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70684add-1bc1-4091-88da-328607d5f9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70684add-1bc1-4091-88da-328607d5f9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0397ad5-df90-4df8-8cd1-58267b8906c5', 'volume_name': 'volume-a0397ad5-df90-4df8-8cd1-58267b8906c5', 'volume_size': 2, 'snapshot_id': 'de96bbcb-2d80-4307-86e3-3d4603ec3033'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8846c5c-38c5-46f0-abd8-97e92cdfec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8846c5c-38c5-46f0-abd8-97e92cdfec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e46cbad-a040-48c6-adb8-6f48df055d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume a0397ad5-df90-4df8-8cd1-58267b8906c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0397ad5-df90-4df8-8cd1-58267b8906c5', 'volume_size': 2, 'snapshot_id': 'de96bbcb-2d80-4307-86e3-3d4603ec3033'}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033-a0397ad5-df90-4df8-8cd1-58267b8906c5" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033-a0397ad5-df90-4df8-8cd1-58267b8906c5" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating volume a0397ad5-df90-4df8-8cd1-58267b8906c5 from snapshot de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] snapshot: de96bbcb-2d80-4307-86e3-3d4603ec3033, volume: a0397ad5-df90-4df8-8cd1-58267b8906c5,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3fdccd-6714-4ae9-b3e3-f8fb1071e3d9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:22 devstack sudo[92155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:22 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:22 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.741s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95594b69-db0a-4e74-8124-57f2d8ec2247]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (afd14b3b-0711-4ca3-bfdb-b1291b705e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb78e60-1941-4267-af0d-42a37f0d3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb78e60-1941-4267-af0d-42a37f0d3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328866878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dee9624-6e40-4c61-9b97-3638df05207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:23Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5adda3-d323-4236-be8c-56f694744ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5adda3-d323-4236-be8c-56f694744ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:22 devstack sudo[92160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:22 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618f1b4-aaba-4dc0-aced-6c762a2058ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4618f1b4-aaba-4dc0-aced-6c762a2058ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dee9624-6e40-4c61-9b97-3638df05207e', 'volume_name': 'volume-7dee9624-6e40-4c61-9b97-3638df05207e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10391819-d69a-490b-a01b-cbb846596480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10391819-d69a-490b-a01b-cbb846596480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdc9608-f184-4a26-b3f8-daa70b2332a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Volume 7dee9624-6e40-4c61-9b97-3638df05207e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dee9624-6e40-4c61-9b97-3638df05207e', 'volume_size': 1}
Apr 29 08:44:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (2d737c24-4d58-4fe6-8b83-479d90f5593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6c4738-cda0-4889-b822-1a8842b0ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6c4738-cda0-4889-b822-1a8842b0ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839866088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04cbcd73-ddfc-401f-b801-09542be58ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:23Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf816ef0-40c1-4930-b29d-9061c2e6c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf816ef0-40c1-4930-b29d-9061c2e6c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75da45e7-a282-4a61-bec2-5f792928cff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75da45e7-a282-4a61-bec2-5f792928cff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04cbcd73-ddfc-401f-b801-09542be58ff8', 'volume_name': 'volume-04cbcd73-ddfc-401f-b801-09542be58ff8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a005a08a-1cb0-41a5-9ccd-69a8b264598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a005a08a-1cb0-41a5-9ccd-69a8b264598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaac1d7d-c6a5-410f-a735-00983bed1328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Volume 04cbcd73-ddfc-401f-b801-09542be58ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04cbcd73-ddfc-401f-b801-09542be58ff8', 'volume_size': 1}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:23 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.879s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:23 devstack sudo[92165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5
Apr 29 08:44:23 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (41ba77fe-44d1-4fc9-9fac-3687aeec549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4f95fd-36e3-460d-abf1-9ed2f65d6833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4f95fd-36e3-460d-abf1-9ed2f65d6833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389166629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedeb306-b5aa-4ae9-966c-291da82c16f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad046e34-fdcd-4bb8-a36a-0317418fb39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad046e34-fdcd-4bb8-a36a-0317418fb39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10618394-a755-435b-9e58-efe5823c62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10618394-a755-435b-9e58-efe5823c62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedeb306-b5aa-4ae9-966c-291da82c16f8', 'volume_name': 'volume-eedeb306-b5aa-4ae9-966c-291da82c16f8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5af1e0-2889-4511-885f-e05970d69d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5af1e0-2889-4511-885f-e05970d69d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf5a5e-4e69-43b0-96a4-bf6b66366223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Volume eedeb306-b5aa-4ae9-966c-291da82c16f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedeb306-b5aa-4ae9-966c-291da82c16f8', 'volume_size': 1}
Apr 29 08:44:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (13042b3d-c544-4635-9132-87498234da89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d885b5-983c-4a0e-8b5d-204d29a74a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d885b5-983c-4a0e-8b5d-204d29a74a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597842645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa930a4-0f09-4a96-a1ef-39ad0b278e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9456d1f-6c95-4234-8491-b7f0e65e28cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9456d1f-6c95-4234-8491-b7f0e65e28cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e031d4-df30-4a11-a53a-38ba6ae5ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e031d4-df30-4a11-a53a-38ba6ae5ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa930a4-0f09-4a96-a1ef-39ad0b278e17', 'volume_name': 'volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f047eb53-fbb3-41b1-baa3-4df1130bbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f047eb53-fbb3-41b1-baa3-4df1130bbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d9c1d8-2cf3-4242-84bd-87bcb33df846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Volume cfa930a4-0f09-4a96-a1ef-39ad0b278e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17', 'volume_size': 1}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (35bf25fd-187b-4419-a485-56e9e4309a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b8ba4-d54f-4c6c-b4f0-ccc2cdaa4db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b8ba4-d54f-4c6c-b4f0-ccc2cdaa4db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874945715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e8e907-bf4f-40c2-8183-74d2480b8775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b5ff87-c698-4dc9-8f8e-7e67ce0458d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b5ff87-c698-4dc9-8f8e-7e67ce0458d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d6ec38-3864-40f4-bf05-1d76021f52b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25d6ec38-3864-40f4-bf05-1d76021f52b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e8e907-bf4f-40c2-8183-74d2480b8775', 'volume_name': 'volume-c4e8e907-bf4f-40c2-8183-74d2480b8775', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ca6968-cba4-4faf-9149-1a27c3889708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ca6968-cba4-4faf-9149-1a27c3889708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0332f-0a0d-4797-b9a8-9c0661dd72da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Volume c4e8e907-bf4f-40c2-8183-74d2480b8775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e8e907-bf4f-40c2-8183-74d2480b8775', 'volume_size': 1}
Apr 29 08:44:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:28 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5" returned: 0 in 4.664s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:28 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d756607-9fc0-424e-9f92-26d5b2620128]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:28 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:28 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:29 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.910s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:44:29 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Converted 1024.00 MB image at 219.51 MB/s
Apr 29 08:44:29 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 is being set with open permissions: ugo+rw
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:29 devstack sudo[92184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5
Apr 29 08:44:29 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:29 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5" returned: 0 in 0.606s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" released by "_copy_volume_from_snapshot" :: held 7.910s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033-a0397ad5-df90-4df8-8cd1-58267b8906c5" released by "_create_volume_from_snapshot" :: held 7.946s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.963s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.944s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-328866878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dee9624-6e40-4c61-9b97-3638df05207e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:23Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Creating volume 7dee9624-6e40-4c61-9b97-3638df05207e {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:29 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:29 devstack sudo[92187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e 1073741824
Apr 29 08:44:29 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e46cbad-a040-48c6-adb8-6f48df055d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0397ad5-df90-4df8-8cd1-58267b8906c5', 'volume_size': 2, 'snapshot_id': 'de96bbcb-2d80-4307-86e3-3d4603ec3033'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc15022-a550-4339-9b5f-f96edc28d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:29 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 (a0397ad5-df90-4df8-8cd1-58267b8906c5): created successfully
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc15022-a550-4339-9b5f-f96edc28d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:29 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (9f4a740e-e2ad-41ae-a923-1aa70a2d34fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:29 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-86c08709-1f4f-436f-b960-ea6b563a0762 tempest-VolumesSnapshotTestJSON-1872334576 None] Created volume successfully.
Apr 29 08:44:30 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e 1073741824" returned: 0 in 0.847s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-a0397ad5-df90-4df8-8cd1-58267b8906c5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-a0397ad5-df90-4df8-8cd1-58267b8906c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:30 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e
Apr 29 08:44:30 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770742a-8d81-4a58-ac5b-044a8d9df7eb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:30 devstack sudo[92196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5
Apr 29 08:44:30 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:31 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e" returned: 0 in 0.604s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.926s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1839866088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04cbcd73-ddfc-401f-b801-09542be58ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:23Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Creating volume 04cbcd73-ddfc-401f-b801-09542be58ff8 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:31 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fdc9608-f184-4a26-b3f8-daa70b2332a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dee9624-6e40-4c61-9b97-3638df05207e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:31 devstack sudo[92199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 1073741824
Apr 29 08:44:31 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039348c-6dfc-48d2-8a96-97558da275a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:31 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Volume volume-7dee9624-6e40-4c61-9b97-3638df05207e (7dee9624-6e40-4c61-9b97-3638df05207e): created successfully
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039348c-6dfc-48d2-8a96-97558da275a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (afd14b3b-0711-4ca3-bfdb-b1291b705e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2a63b272-62a0-4cd0-8935-057ea75dbfa2 tempest-CreateVolumesFromImageTest-1707465912 None] Created volume successfully.
Apr 29 08:44:31 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5" returned: 0 in 0.821s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:31 devstack sudo[92204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5
Apr 29 08:44:31 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:32 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 1073741824" returned: 0 in 0.782s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:32 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8
Apr 29 08:44:32 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:32 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-a0397ad5-df90-4df8-8cd1-58267b8906c5" returned: 0 in 0.645s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-a0397ad5-df90-4df8-8cd1-58267b8906c5" released by "delete_volume" :: held 1.511s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['ac675274-110b-401a-903c-926b0277c480', '0640492f-0bb6-41f1-8abb-29ab04bf1f14', '25370cdb-deeb-4c4f-9ecf-e803e2b1be6e', '37556eb7-4f5a-4d40-b04a-e10cb3e89b78'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:32 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:32 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:32 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8" returned: 0 in 0.590s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.036s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-389166629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedeb306-b5aa-4ae9-966c-291da82c16f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Creating volume eedeb306-b5aa-4ae9-966c-291da82c16f8 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:32 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:32 devstack sudo[92215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 1073741824
Apr 29 08:44:32 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaac1d7d-c6a5-410f-a735-00983bed1328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04cbcd73-ddfc-401f-b801-09542be58ff8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3742b61-9e34-48f9-a3a4-0f8003acc512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:32 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Volume volume-04cbcd73-ddfc-401f-b801-09542be58ff8 (04cbcd73-ddfc-401f-b801-09542be58ff8): created successfully
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3742b61-9e34-48f9-a3a4-0f8003acc512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:32 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (2d737c24-4d58-4fe6-8b83-479d90f5593f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:32 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2bad0611-bb2a-4000-b8e2-2437482c20bf tempest-CreateVolumesFromImageTest-1707465912 None] Created volume successfully.
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-de96bbcb-2d80-4307-86e3-3d4603ec3033-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:33 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.586s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:33 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Deleted volume successfully.
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-de96bbcb-2d80-4307-86e3-3d4603ec3033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2d3f2d7e-1fcb-4d97-9c78-03c2e183db9b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-a0397ad5-df90-4df8-8cd1-58267b8906c5-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Deleting offline snapshot de96bbcb-2d80-4307-86e3-3d4603ec3033 of volume 3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] snapshot_file for this snap is: volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e60ca1-8a9a-49c8-88ef-81e4d1f7fdd0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:33 devstack sudo[92218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:33 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:33 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 1073741824" returned: 0 in 0.880s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:33 devstack sudo[92223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8
Apr 29 08:44:33 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:33 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.769s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[669cc21b-d23b-4094-8394-0ff3813f1d7a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:34 devstack sudo[92228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:34 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:34 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8" returned: 0 in 0.671s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.282s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1597842645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa930a4-0f09-4a96-a1ef-39ad0b278e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Creating volume cfa930a4-0f09-4a96-a1ef-39ad0b278e17 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:34 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf5a5e-4e69-43b0-96a4-bf6b66366223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedeb306-b5aa-4ae9-966c-291da82c16f8', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:34 devstack sudo[92231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 1073741824
Apr 29 08:44:34 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a9be84-afc7-4d56-b9d1-37cbf362ff8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:34 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Volume volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 (eedeb306-b5aa-4ae9-966c-291da82c16f8): created successfully
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a9be84-afc7-4d56-b9d1-37cbf362ff8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (41ba77fe-44d1-4fc9-9fac-3687aeec549e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:34 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-539fddb3-dd2f-4665-b12d-266a20f4574a tempest-CreateVolumesFromImageTest-1707465912 None] Created volume successfully.
Apr 29 08:44:34 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.744s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:34 devstack sudo[92236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:34 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:35 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 1073741824" returned: 0 in 0.762s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:35 devstack sudo[92241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17
Apr 29 08:44:35 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:35 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.730s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:35 devstack sudo[92246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033
Apr 29 08:44:35 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:35 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" returned: 0 in 0.592s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.304s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-874945715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e8e907-bf4f-40c2-8183-74d2480b8775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1979e6541e3a421c8b1d948e35486953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:24Z,use_quota=True,user_id='79d902c333c84d1cbb2dff8922947b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Creating volume c4e8e907-bf4f-40c2-8183-74d2480b8775 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:35 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:35 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 1073741824
Apr 29 08:44:35 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d9c1d8-2cf3-4242-84bd-87bcb33df846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f57268-5e42-4e1c-9efe-9b49bf27d365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:35 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Volume volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 (cfa930a4-0f09-4a96-a1ef-39ad0b278e17): created successfully
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f57268-5e42-4e1c-9efe-9b49bf27d365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (13042b3d-c544-4635-9132-87498234da89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3ddd60e2-5b39-44c4-999a-d504d47a11d1 tempest-CreateVolumesFromImageTest-1707465912 None] Created volume successfully.
Apr 29 08:44:36 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7.de96bbcb-2d80-4307-86e3-3d4603ec3033" returned: 0 in 0.593s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-de96bbcb-2d80-4307-86e3-3d4603ec3033" released by "_delete_snapshot" :: held 2.982s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" released by "delete_snapshot" :: held 3.010s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['eacdb2c7-7746-4699-8972-9e38ac1697a3', 'd103a5f9-7c89-4fef-a850-4779506b4652', '88d9135d-b9bd-4f84-902b-95c9878352b3', '0fc75d18-6a15-4ef8-b6f4-6ddaf10b135e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Delete snapshot completed successfully.
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-60f8295a-d109-4cec-b4fc-6035f1f4667a tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-de96bbcb-2d80-4307-86e3-3d4603ec3033-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-3255189f-7a28-47fc-a8f1-57ec9f9860f7-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-3255189f-7a28-47fc-a8f1-57ec9f9860f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36430d4-00b4-4084-819b-9487f1ced8dd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:36 devstack sudo[92255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:36 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:36 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 1073741824" returned: 0 in 0.950s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:36 devstack sudo[92258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775
Apr 29 08:44:36 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:37 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.788s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:37 devstack sudo[92263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7
Apr 29 08:44:37 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:37 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775" returned: 0 in 0.636s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d0332f-0a0d-4797-b9a8-9c0661dd72da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e8e907-bf4f-40c2-8183-74d2480b8775', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8edb8bb1-ec03-4144-b672-d05068e6002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:37 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Volume volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 (c4e8e907-bf4f-40c2-8183-74d2480b8775): created successfully
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8edb8bb1-ec03-4144-b672-d05068e6002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Flow 'volume_create_manager' (35bf25fd-187b-4419-a485-56e9e4309a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:37 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1a2c5ae0-6b21-4d88-970a-75023b8a40b9 tempest-CreateVolumesFromImageTest-1707465912 None] Created volume successfully.
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-c4e8e907-bf4f-40c2-8183-74d2480b8775-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-c4e8e907-bf4f-40c2-8183-74d2480b8775-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-quobyte-c4e8e907-bf4f-40c2-8183-74d2480b8775" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-c4e8e907-bf4f-40c2-8183-74d2480b8775" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[71603751-f05b-41ca-bff3-768419dfcab2]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:37 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-3255189f-7a28-47fc-a8f1-57ec9f9860f7" returned: 0 in 0.661s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-3255189f-7a28-47fc-a8f1-57ec9f9860f7" released by "delete_volume" :: held 1.539s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:37 devstack sudo[92267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775
Apr 29 08:44:37 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['e6abc55e-fa47-4fba-a431-669a43ea71c9', '0f071b98-7ff8-4242-9bc7-193aa8001a45', '73478bc6-1a9c-45a1-89ec-ca8b5133c035', '7941a25d-b3ec-455f-87df-67a77548fab7'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:38 devstack sudo[92269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:38 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:38 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775" returned: 0 in 0.771s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:38 devstack sudo[92275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775
Apr 29 08:44:38 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:38 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.621s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:38 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Deleted volume successfully.
Apr 29 08:44:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a3db7324-4a25-4267-b0d0-fdfbbd5fc255 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-3255189f-7a28-47fc-a8f1-57ec9f9860f7-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (75bf5c4f-8069-45df-a5d6-379eae69d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d5a6c2-bf03-42f6-872a-a2543f54ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d5a6c2-bf03-42f6-872a-a2543f54ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-683142581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7d14cb-1f68-4ff6-818f-9d787c4f5b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:39Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e74561-eea7-4f7b-85e2-d34b7709d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e74561-eea7-4f7b-85e2-d34b7709d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b5c94a-8e8b-4715-9ea3-0fa3b72d5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b5c94a-8e8b-4715-9ea3-0fa3b72d5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7d14cb-1f68-4ff6-818f-9d787c4f5b29', 'volume_name': 'volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c608e1-a6a4-4a79-a3ef-084ff4c38974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c608e1-a6a4-4a79-a3ef-084ff4c38974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79861531-1cc6-4ecb-a971-8c9fb960bc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:39 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Volume 1a7d14cb-1f68-4ff6-818f-9d787c4f5b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29', 'volume_size': 1}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-683142581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7d14cb-1f68-4ff6-818f-9d787c4f5b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:39Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Creating volume 1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:39 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:39 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c4e8e907-bf4f-40c2-8183-74d2480b8775" returned: 0 in 0.657s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:39 devstack sudo[92278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 1073741824
Apr 29 08:44:39 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-c4e8e907-bf4f-40c2-8183-74d2480b8775" released by "delete_volume" :: held 1.482s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Created reservations ['6da3f1df-eff1-4760-b268-7a992968c5b5', 'a5775738-4067-4d5c-b46b-8c0fe626975a', 'ba08edd9-34c7-4f12-961c-e3c9304dfb67', 'e2f52b07-7d91-4272-9c6e-0131aa7e7fb7'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:39 devstack sudo[92280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:39 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-cfa930a4-0f09-4a96-a1ef-39ad0b278e17-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-cfa930a4-0f09-4a96-a1ef-39ad0b278e17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:40 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.621s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=103,cinder:INSERT=31,cinder:UPDATE=139,cinder:DELETE=16 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:44:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Deleted volume successfully.
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d2afe6f6-b9c5-4170-a7fa-f213012cd4c2 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-c4e8e907-bf4f-40c2-8183-74d2480b8775-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-quobyte-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:40 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102e934-adae-441c-9d9c-5011a1276018]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 1073741824" returned: 0 in 0.908s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:40 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:44:40 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:40 devstack sudo[92287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17
Apr 29 08:44:40 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:40 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.616s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79861531-1cc6-4ecb-a971-8c9fb960bc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15447e56-23e1-415f-be27-70aab37b157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Volume volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 (1a7d14cb-1f68-4ff6-818f-9d787c4f5b29): created successfully
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15447e56-23e1-415f-be27-70aab37b157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (75bf5c4f-8069-45df-a5d6-379eae69d246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a7079cce-4c9f-47bc-91db-017afe9623ab tempest-VolumesSnapshotTestJSON-1872334576 None] Created volume successfully.
Apr 29 08:44:40 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" returned: 0 in 0.754s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:40 devstack sudo[92296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17
Apr 29 08:44:40 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=110,cinder:INSERT=32,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating offline snapshot 79b1616d-c88b-4666-aef9-b427cc0815b2 of volume 1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b8dec-f76a-44a8-9840-da67d1a1b3d8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:41 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" returned: 0 in 0.648s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-cfa930a4-0f09-4a96-a1ef-39ad0b278e17" released by "delete_volume" :: held 1.462s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:41 devstack sudo[92299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:44:41 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Created reservations ['f4afaa56-2b8a-4837-8aac-7423624c1dac', 'f61a422a-6374-496f-b0b8-1cb14ab8c798', 'b5d60490-19a7-4596-8268-9813941e4c0c', 'b0d197f8-ae0b-4edc-bca2-b18a54becd90'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:41 devstack sudo[92301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:41 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:42 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.753s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-eedeb306-b5aa-4ae9-966c-291da82c16f8-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:42 devstack sudo[92307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 1G
Apr 29 08:44:42 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-eedeb306-b5aa-4ae9-966c-291da82c16f8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-quobyte-eedeb306-b5aa-4ae9-966c-291da82c16f8" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:42 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-eedeb306-b5aa-4ae9-966c-291da82c16f8" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Deleted volume successfully.
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc654c-8da3-4f62-a705-693daf3debc5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2aaf614a-db68-48bc-9631-abfef61fe4ff tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-cfa930a4-0f09-4a96-a1ef-39ad0b278e17-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:42 devstack sudo[92309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8
Apr 29 08:44:42 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 1G" returned: 0 in 0.798s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:43 devstack sudo[92316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:44:43 devstack sudo[92316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8" returned: 0 in 0.787s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:43 devstack sudo[92319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8
Apr 29 08:44:43 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92316]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.695s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 is being set with open permissions: ugo+rw
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:43 devstack sudo[92325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:44:43 devstack sudo[92325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:43 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eedeb306-b5aa-4ae9-966c-291da82c16f8" returned: 0 in 0.631s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-eedeb306-b5aa-4ae9-966c-291da82c16f8" released by "delete_volume" :: held 1.475s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Created reservations ['6e0b45aa-e0a3-46ee-a34c-5c80be10c32f', '99f13567-e514-4d14-b21b-5989624c6ca8', '7a80c8f8-f68b-49ef-820b-ca85abdbb9f6', '8dd1fa13-c4f6-4556-8132-8708129750d0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:43 devstack sudo[92327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:43 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:44 devstack sudo[92325]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.617s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:44 devstack sudo[92330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info
Apr 29 08:44:44 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-04cbcd73-ddfc-401f-b801-09542be58ff8-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-04cbcd73-ddfc-401f-b801-09542be58ff8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:44 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-quobyte-04cbcd73-ddfc-401f-b801-09542be58ff8" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Deleted volume successfully.
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-04cbcd73-ddfc-401f-b801-09542be58ff8" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ce02cd0e-f8e6-4d18-9363-cbd03f91ad07 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-eedeb306-b5aa-4ae9-966c-291da82c16f8-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345a844-4e7c-4529-bbbd-bac52dd6193a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:44 devstack sudo[92333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8
Apr 29 08:44:44 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:45 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info" returned: 0 in 0.647s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info is being set with open permissions: ugo+rw
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:45 devstack sudo[92336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info
Apr 29 08:44:45 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:45 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8" returned: 0 in 0.730s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:45 devstack sudo[92341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8
Apr 29 08:44:45 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:45 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.info" returned: 0 in 0.646s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.266s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-bfff8cd6-b524-4d94-b664-972fe5d9a711 tempest-VolumesSnapshotTestJSON-1872334576 None] Create snapshot completed successfully
Apr 29 08:44:45 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-04cbcd73-ddfc-401f-b801-09542be58ff8" returned: 0 in 0.593s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-04cbcd73-ddfc-401f-b801-09542be58ff8" released by "delete_volume" :: held 1.373s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Created reservations ['3a31dcdf-88aa-478e-b37e-922d9dcda72b', '67b3bb1c-5adb-4692-9e6b-437ebf8375cc', 'f741f6fa-f4dc-45ce-b020-973196e6dbfa', '3202a175-6c81-483b-bd6d-afadd9c2ba71'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:46 devstack sudo[92345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:46 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:46 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.640s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Deleted volume successfully.
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a5aac2bd-b1cf-49cf-bc0b-5b68273bf1fb tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-04cbcd73-ddfc-401f-b801-09542be58ff8-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-7dee9624-6e40-4c61-9b97-3638df05207e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-7dee9624-6e40-4c61-9b97-3638df05207e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "cinder-quobyte-7dee9624-6e40-4c61-9b97-3638df05207e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-7dee9624-6e40-4c61-9b97-3638df05207e" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87761fb0-05a8-49dd-8fad-3fc7e158d1a5]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:47 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e
Apr 29 08:44:47 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (ab5e7ae2-b87c-4acb-a0cb-e2701fd25870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a640b1-8971-468c-8197-9c4b25cdc06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a640b1-8971-468c-8197-9c4b25cdc06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-533877636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb0e5061-2b80-4467-b254-9b034533a85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb19a4330b1410e9bf5510148dfa5a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=79b1616d-c88b-4666-aef9-b427cc0815b2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:44:47Z,use_quota=True,user_id='85413b0d132744ae81f25706084cbfe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1052ae-ea03-42d0-a2a1-e247f53f26f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1052ae-ea03-42d0-a2a1-e247f53f26f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1d9a44-236c-4a54-a118-8b136bdf90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1d9a44-236c-4a54-a118-8b136bdf90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb0e5061-2b80-4467-b254-9b034533a85f', 'volume_name': 'volume-bb0e5061-2b80-4467-b254-9b034533a85f', 'volume_size': 1, 'snapshot_id': '79b1616d-c88b-4666-aef9-b427cc0815b2'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cd5451-211c-4bcd-af2c-d08590269f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cd5451-211c-4bcd-af2c-d08590269f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d85ab1-bf3e-458a-b5d3-5985e9ce29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:47 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume bb0e5061-2b80-4467-b254-9b034533a85f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb0e5061-2b80-4467-b254-9b034533a85f', 'volume_size': 1, 'snapshot_id': '79b1616d-c88b-4666-aef9-b427cc0815b2'}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2-bb0e5061-2b80-4467-b254-9b034533a85f" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2-bb0e5061-2b80-4467-b254-9b034533a85f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating volume bb0e5061-2b80-4467-b254-9b034533a85f from snapshot 79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] snapshot: 79b1616d-c88b-4666-aef9-b427cc0815b2, volume: bb0e5061-2b80-4467-b254-9b034533a85f,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5ec8bc-965a-42ba-97ea-5fc33de08c0b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:47 devstack sudo[92351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:44:47 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:47 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e" returned: 0 in 0.818s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:47 devstack sudo[92356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e
Apr 29 08:44:47 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:48 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.797s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca8529-1ed3-4a8f-b558-9ee79e13ff41]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:48 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:44:48 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:48 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7dee9624-6e40-4c61-9b97-3638df05207e" returned: 0 in 0.673s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-quobyte-7dee9624-6e40-4c61-9b97-3638df05207e" released by "delete_volume" :: held 1.557s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Created reservations ['4428e85b-b4de-4ec0-b2aa-456cce2351f3', 'cd86bb2c-6e6f-4070-b30e-58eb026e8e23', '46658bb3-7bf3-4485-8627-b3a5d45096d1', '01d1777b-1423-4c3a-8275-d23c071791b2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:48 devstack sudo[92365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:48 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.821s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:49 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:49 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f
Apr 29 08:44:49 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:49 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.623s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Deleted volume successfully.
Apr 29 08:44:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c05aeab9-d56d-460c-8053-85c583e08720 tempest-CreateVolumesFromImageTest-1707465912 None] Lock "cinder-7dee9624-6e40-4c61-9b97-3638df05207e-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:54 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f" returned: 0 in 4.952s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f165e7c-01c4-4334-93ea-8b3d9684103d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:54 devstack sudo[92388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:44:54 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:54 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.846s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:44:54 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Converted 1024.00 MB image at 206.75 MB/s
Apr 29 08:44:54 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f is being set with open permissions: ugo+rw
Apr 29 08:44:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:54 devstack sudo[92393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f
Apr 29 08:44:54 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:55 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f" returned: 0 in 0.580s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" released by "_copy_volume_from_snapshot" :: held 8.101s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2-bb0e5061-2b80-4467-b254-9b034533a85f" released by "_create_volume_from_snapshot" :: held 8.131s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.149s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d85ab1-bf3e-458a-b5d3-5985e9ce29d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0e5061-2b80-4467-b254-9b034533a85f', 'volume_size': 1, 'snapshot_id': '79b1616d-c88b-4666-aef9-b427cc0815b2'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5d75a2-1ea7-4495-98ed-014720ffbff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:44:55 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Volume volume-bb0e5061-2b80-4467-b254-9b034533a85f (bb0e5061-2b80-4467-b254-9b034533a85f): created successfully
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5d75a2-1ea7-4495-98ed-014720ffbff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:44:55 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Flow 'volume_create_manager' (ab5e7ae2-b87c-4acb-a0cb-e2701fd25870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:44:55 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-94385b12-70d8-47d3-956d-81f07bbb90b7 tempest-VolumesSnapshotTestJSON-1872334576 None] Created volume successfully.
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-bb0e5061-2b80-4467-b254-9b034533a85f-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-bb0e5061-2b80-4467-b254-9b034533a85f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" acquired by "delete_volume" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417b87c-211a-4315-8b41-cc3fb377e2db]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:56 devstack sudo[92397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f
Apr 29 08:44:56 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:56 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f" returned: 0 in 0.715s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:57 devstack sudo[92402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f
Apr 29 08:44:57 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:57 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bb0e5061-2b80-4467-b254-9b034533a85f" returned: 0 in 0.650s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-bb0e5061-2b80-4467-b254-9b034533a85f" released by "delete_volume" :: held 1.408s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['3820f457-963d-4054-853f-79e1ecf3d492', '630d8bf8-3231-4621-b588-5c10985b6182', '06bd0dbe-6f9f-4f98-ab28-fc75d3f56619', 'b48af2b4-d32d-4445-aad6-3d774341e214'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:44:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:57 devstack sudo[92405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:44:57 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:58 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.600s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:44:58 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Deleted volume successfully.
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8d96f14b-e8f2-402e-9439-205c274a2f4c tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-bb0e5061-2b80-4467-b254-9b034533a85f-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-79b1616d-c88b-4666-aef9-b427cc0815b2-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-79b1616d-c88b-4666-aef9-b427cc0815b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Deleting offline snapshot 79b1616d-c88b-4666-aef9-b427cc0815b2 of volume 1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] snapshot_file for this snap is: volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[424521f1-6439-48fe-b84a-90e289ec28c6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:58 devstack sudo[92408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:44:58 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:59 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root
Apr 29 08:44:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.711s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:44:59 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:44:59 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd27b4-5d79-4468-89d9-de12871586dd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:44:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:44:59 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:44:59 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:44:59 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.710s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:00 devstack sudo[92454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:45:00 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:00 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.712s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:00 devstack sudo[92460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2
Apr 29 08:45:00 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:01 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29.79b1616d-c88b-4666-aef9-b427cc0815b2" returned: 0 in 0.609s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-79b1616d-c88b-4666-aef9-b427cc0815b2" released by "_delete_snapshot" :: held 2.840s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" released by "delete_snapshot" :: held 2.864s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['86b309e8-51d6-4574-8ec8-512d9d469a70', '89da514c-4810-41ab-a246-4c1c5bd70cc2', 'ca4ec158-a170-440a-9712-f9b4abd07b70', '28f71957-c2bc-474e-a48c-c732ed922c94'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:01 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Delete snapshot completed successfully.
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5157f404-c4b9-480e-aff5-ff1b21cb4633 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-79b1616d-c88b-4666-aef9-b427cc0815b2-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" acquired by "delete_volume" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37e9a4-8a8a-46b1-bcd7-dcf85b333aa8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:01 devstack sudo[92463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:45:01 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:02 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.798s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:02 devstack sudo[92471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29
Apr 29 08:45:02 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:03 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" returned: 0 in 0.599s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29" released by "delete_volume" :: held 1.454s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['aec1d2ea-4e64-40ca-980f-be2e23f7599f', '191fa50d-56a5-457b-b57c-b3d4fc43aa15', '01503861-579e-4bf3-9439-5f32ec9a96e9', '44b034ac-248d-4a04-b418-e9c27172cba9'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:03 devstack sudo[92474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:03 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:03 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.622s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:03 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Deleted volume successfully.
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-31e77f89-6729-4a90-9fa9-e37554938f8b tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-1a7d14cb-1f68-4ff6-818f-9d787c4f5b29-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-18e119cc-751d-4992-964c-21259fac55e4-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-18e119cc-751d-4992-964c-21259fac55e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9f30f3-52c5-437d-8946-9e45d2f03111]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:04 devstack sudo[92477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4
Apr 29 08:45:04 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:04 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4" returned: 0 in 0.777s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:04 devstack sudo[92482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4
Apr 29 08:45:04 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:05 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-18e119cc-751d-4992-964c-21259fac55e4" returned: 0 in 0.588s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-quobyte-18e119cc-751d-4992-964c-21259fac55e4" released by "delete_volume" :: held 1.424s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Created reservations ['f7700230-6a25-4dcc-ae6f-26e1073029ba', 'bbd7c96f-f7f3-43ed-8300-63566925fa7d', '55e1fea0-93fc-4073-b102-8a52a4e57d26', '56a45632-18f9-44d2-b2cb-65755db95063'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:05 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:05 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:06 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.571s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:06 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:06 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Deleted volume successfully.
Apr 29 08:45:06 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-70f44c45-1dda-4e32-a810-cd5ee4f50b04 tempest-VolumesSnapshotTestJSON-1872334576 None] Lock "cinder-18e119cc-751d-4992-964c-21259fac55e4-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=67,cinder:SELECT=44,cinder:DELETE=6,cinder:INSERT=19 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=47,cinder:INSERT=14,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:16 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:16 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:17 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.669s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (09aff84c-54ba-4832-ab46-e3fd0c4a1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d96b6b7-f559-4996-b98b-b489ec24c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d96b6b7-f559-4996-b98b-b489ec24c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186721011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6003fb-e457-42f1-b250-55984bb9598c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:20Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f9ec91-1f33-4f18-84c6-6a7d58161bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f9ec91-1f33-4f18-84c6-6a7d58161bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b535d-ac32-448f-8c63-d15d6557619b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4b535d-ac32-448f-8c63-d15d6557619b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e6003fb-e457-42f1-b250-55984bb9598c', 'volume_name': 'volume-2e6003fb-e457-42f1-b250-55984bb9598c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff7013a-fc07-4c2c-bf6b-5bb8e51da371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff7013a-fc07-4c2c-bf6b-5bb8e51da371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7daea8-cb4a-423e-b1f3-de99c7a6a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Volume 2e6003fb-e457-42f1-b250-55984bb9598c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e6003fb-e457-42f1-b250-55984bb9598c', 'volume_size': 1}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-186721011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e6003fb-e457-42f1-b250-55984bb9598c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:20Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Creating volume 2e6003fb-e457-42f1-b250-55984bb9598c {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:20 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:20 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c 1073741824
Apr 29 08:45:20 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (adad440e-b637-40aa-92c2-8a84d4fd19b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e40a97-332e-43bf-ace7-4c5f883468eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e40a97-332e-43bf-ace7-4c5f883468eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330906942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e91a8e7-e820-42b5-98f6-31cd55127e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ad6529-d867-4051-8639-7198e9b21ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ad6529-d867-4051-8639-7198e9b21ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee6bab9-0f83-4e49-ac9d-dc25233ab127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee6bab9-0f83-4e49-ac9d-dc25233ab127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e91a8e7-e820-42b5-98f6-31cd55127e38', 'volume_name': 'volume-0e91a8e7-e820-42b5-98f6-31cd55127e38', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296d2cc-1434-41d0-9acb-0add9621bf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296d2cc-1434-41d0-9acb-0add9621bf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e4d1c-dd9f-43df-a5c1-15589c6d5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume 0e91a8e7-e820-42b5-98f6-31cd55127e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e91a8e7-e820-42b5-98f6-31cd55127e38', 'volume_size': 1}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Flow 'volume_create_manager' (5eade893-cd4c-4b29-832e-063dd1ac8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804cc1b8-9e1b-4ae4-9e9f-f902b68b52b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804cc1b8-9e1b-4ae4-9e9f-f902b68b52b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a02a762-ec40-4bb0-a508-20c96efa463d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded84ee3655c481392493d6dca0268fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='9d208bb1706942cda29de87a859da94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4238564-6261-457d-902c-34656dd17815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4238564-6261-457d-902c-34656dd17815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147990d0-46a8-4f99-94bb-3209ae1644ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147990d0-46a8-4f99-94bb-3209ae1644ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a02a762-ec40-4bb0-a508-20c96efa463d', 'volume_name': 'volume-9a02a762-ec40-4bb0-a508-20c96efa463d', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b15dd9f-1966-44ed-bc97-cfbac2d5b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b15dd9f-1966-44ed-bc97-cfbac2d5b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cd852b-7c74-4fbc-953b-34fa07cd71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:20 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Volume 9a02a762-ec40-4bb0-a508-20c96efa463d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a02a762-ec40-4bb0-a508-20c96efa463d', 'volume_size': 1}
Apr 29 08:45:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (c7afdd78-87c3-4ad0-8348-4abf3f9b6b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370c9d85-ca1e-40a6-9a88-59531e19d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370c9d85-ca1e-40a6-9a88-59531e19d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905955274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cc64f9-b8d1-43a8-9a0d-78390aa11721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a4355-a708-451f-b44b-2e3a1f59cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42a4355-a708-451f-b44b-2e3a1f59cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef9ac41-14ee-471a-9ebe-9bd06e0ae512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef9ac41-14ee-471a-9ebe-9bd06e0ae512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47cc64f9-b8d1-43a8-9a0d-78390aa11721', 'volume_name': 'volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0606a102-ce1e-49ef-9dd9-b87d7e2036e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0606a102-ce1e-49ef-9dd9-b87d7e2036e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e234c179-5782-4016-b1bb-ec1a401b37d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Volume 47cc64f9-b8d1-43a8-9a0d-78390aa11721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721', 'volume_size': 1}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (13e6a2a5-deac-4588-977d-74beb88d42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdce5f8-b92b-49b3-8298-85ccb51c4120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cdce5f8-b92b-49b3-8298-85ccb51c4120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844584932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff7caf3-fd67-4298-ac9a-9834c168441e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e5d2c-d000-41c4-84fa-0f6841a7bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05e5d2c-d000-41c4-84fa-0f6841a7bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa05e5-5283-4a7c-8e55-3d854175c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fa05e5-5283-4a7c-8e55-3d854175c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff7caf3-fd67-4298-ac9a-9834c168441e', 'volume_name': 'volume-eff7caf3-fd67-4298-ac9a-9834c168441e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeea4301-bab2-43c2-8305-d17618b957e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeea4301-bab2-43c2-8305-d17618b957e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fd2343-80a7-4f3c-8a83-c25e301946b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Volume eff7caf3-fd67-4298-ac9a-9834c168441e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff7caf3-fd67-4298-ac9a-9834c168441e', 'volume_size': 1}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:21 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c 1073741824" returned: 0 in 1.120s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:21 devstack sudo[92545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c
Apr 29 08:45:21 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (d1a8c0df-bc88-44c2-afbf-48e8ffc31bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239268e-a293-4180-ac35-ba22f9934065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f239268e-a293-4180-ac35-ba22f9934065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614503266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8b4822-adfc-401c-8c4f-286f34745011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:22Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654d91a1-1a7c-44ec-8438-fc6d54f12750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654d91a1-1a7c-44ec-8438-fc6d54f12750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4eb0dd9-4424-4f81-ba0d-da5559dd1f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4eb0dd9-4424-4f81-ba0d-da5559dd1f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8b4822-adfc-401c-8c4f-286f34745011', 'volume_name': 'volume-ad8b4822-adfc-401c-8c4f-286f34745011', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cbdfc8-e2ea-49da-9f5f-f052ef5b2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cbdfc8-e2ea-49da-9f5f-f052ef5b2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2c43de-731c-4b2c-b69e-e81788283994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Volume ad8b4822-adfc-401c-8c4f-286f34745011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8b4822-adfc-401c-8c4f-286f34745011', 'volume_size': 1}
Apr 29 08:45:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (fe53f4a9-bfe0-4fae-be69-c38efce64a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4c126c-d6fc-40f5-be20-0b405ff0af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4c126c-d6fc-40f5-be20-0b405ff0af69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791177674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a6af43-feef-4b28-a9f1-9af39b3d707b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:22Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663be63-aa28-450d-9924-a05bfffba4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3663be63-aa28-450d-9924-a05bfffba4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6791f4a2-144a-4e18-b230-442f75f13d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6791f4a2-144a-4e18-b230-442f75f13d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a6af43-feef-4b28-a9f1-9af39b3d707b', 'volume_name': 'volume-37a6af43-feef-4b28-a9f1-9af39b3d707b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b204e39e-b9ac-48cc-970e-b79f098c92a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b204e39e-b9ac-48cc-970e-b79f098c92a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616425d8-564e-4e68-affc-8752ae465c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Volume 37a6af43-feef-4b28-a9f1-9af39b3d707b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a6af43-feef-4b28-a9f1-9af39b3d707b', 'volume_size': 1}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:22 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c" returned: 0 in 0.720s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330906942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e91a8e7-e820-42b5-98f6-31cd55127e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume 0e91a8e7-e820-42b5-98f6-31cd55127e38 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:22 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7daea8-cb4a-423e-b1f3-de99c7a6a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e6003fb-e457-42f1-b250-55984bb9598c', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack sudo[92548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 1073741824
Apr 29 08:45:22 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b440079-38f2-4ae0-b0e1-f2e8952210dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Volume volume-2e6003fb-e457-42f1-b250-55984bb9598c (2e6003fb-e457-42f1-b250-55984bb9598c): created successfully
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b440079-38f2-4ae0-b0e1-f2e8952210dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (09aff84c-54ba-4832-ab46-e3fd0c4a1159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:22 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fc94b2df-0908-4c0b-8275-0ff1c7b9875e tempest-CreateVolumesFromImageTest-2009772737 None] Created volume successfully.
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (0137d8bb-cac6-4e81-8331-59b3b8779999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36541d14-c302-4510-b301-7cfbcc04d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36541d14-c302-4510-b301-7cfbcc04d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241374900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082ef521-6db3-4b7b-98e0-893011869cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:23Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90797d-3c8f-4670-8ffb-0ece2402e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90797d-3c8f-4670-8ffb-0ece2402e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a672d8-f0c5-4f15-8308-81194483ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2a672d8-f0c5-4f15-8308-81194483ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082ef521-6db3-4b7b-98e0-893011869cb5', 'volume_name': 'volume-082ef521-6db3-4b7b-98e0-893011869cb5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d3595b-3333-4968-af8c-5c9f3fa19c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d3595b-3333-4968-af8c-5c9f3fa19c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6af6249-fe8c-4bae-8442-f57c449b5999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:22 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Volume 082ef521-6db3-4b7b-98e0-893011869cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082ef521-6db3-4b7b-98e0-893011869cb5', 'volume_size': 1}
Apr 29 08:45:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:23 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 1073741824" returned: 0 in 0.832s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:23 devstack sudo[92553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38
Apr 29 08:45:23 devstack sudo[92553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:23 devstack sudo[92553]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38" returned: 0 in 0.617s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a02a762-ec40-4bb0-a508-20c96efa463d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded84ee3655c481392493d6dca0268fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='9d208bb1706942cda29de87a859da94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Creating volume 9a02a762-ec40-4bb0-a508-20c96efa463d {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:23 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:23 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d 1073741824
Apr 29 08:45:23 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427e4d1c-dd9f-43df-a5c1-15589c6d5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e91a8e7-e820-42b5-98f6-31cd55127e38', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c02170d-a7a8-4371-a20e-34e15108a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:23 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 (0e91a8e7-e820-42b5-98f6-31cd55127e38): created successfully
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c02170d-a7a8-4371-a20e-34e15108a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:23 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (adad440e-b637-40aa-92c2-8a84d4fd19b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:23 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-798c3dce-1fd9-4b87-95e2-1e8afe0dd641 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:24 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d 1073741824" returned: 0 in 0.779s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:24 devstack sudo[92561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d
Apr 29 08:45:24 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (d317d005-35da-435c-82cd-9b664e42b1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08544a2-6431-438d-a92c-2c1f2b3c5446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08544a2-6431-438d-a92c-2c1f2b3c5446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485230138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2157f7-a366-47f8-8b02-9f4dc9c3d04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422c040f-c2ad-419d-a415-8411c368e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422c040f-c2ad-419d-a415-8411c368e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0af151-e5a2-4250-a7c4-01f78bcad666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0af151-e5a2-4250-a7c4-01f78bcad666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2157f7-a366-47f8-8b02-9f4dc9c3d04e', 'volume_name': 'volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca64fe6-df79-43e4-8d88-58a0a0520d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca64fe6-df79-43e4-8d88-58a0a0520d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e4e190-cce0-4850-bf5f-661909afd1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:24 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume 2b2157f7-a366-47f8-8b02-9f4dc9c3d04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e', 'volume_size': 1}
Apr 29 08:45:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (b0e0784d-5700-4b5c-9f62-4ee2ae50f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b0cdaa-8ce4-473f-bbe1-0fee1a0c3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b0cdaa-8ce4-473f-bbe1-0fee1a0c3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881376061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec693284-83a5-4dda-9429-098cdf1a89c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6de5ce-02ec-4a3f-bf9f-5d2e4a0de6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6de5ce-02ec-4a3f-bf9f-5d2e4a0de6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63de784e-5791-48cb-aa96-291432caef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63de784e-5791-48cb-aa96-291432caef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec693284-83a5-4dda-9429-098cdf1a89c4', 'volume_name': 'volume-ec693284-83a5-4dda-9429-098cdf1a89c4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670488f7-0e1f-491f-9987-dde00609a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (670488f7-0e1f-491f-9987-dde00609a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977d76c-82c1-4c3c-b3a3-32835a840059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume ec693284-83a5-4dda-9429-098cdf1a89c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec693284-83a5-4dda-9429-098cdf1a89c4', 'volume_size': 1}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:25 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d" returned: 0 in 0.666s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.060s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905955274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47cc64f9-b8d1-43a8-9a0d-78390aa11721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Creating volume 47cc64f9-b8d1-43a8-9a0d-78390aa11721 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:25 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3cd852b-7c74-4fbc-953b-34fa07cd71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a02a762-ec40-4bb0-a508-20c96efa463d', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998cabcd-2c1b-40c6-82ff-9ac610dfb7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 1073741824
Apr 29 08:45:25 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Volume volume-9a02a762-ec40-4bb0-a508-20c96efa463d (9a02a762-ec40-4bb0-a508-20c96efa463d): created successfully
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998cabcd-2c1b-40c6-82ff-9ac610dfb7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Flow 'volume_create_manager' (5eade893-cd4c-4b29-832e-063dd1ac8d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:25 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d187eadf-b2b7-47f3-b760-16093b1c4305 tempest-CinderUnicodeTest-25332696 None] Created volume successfully.
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (85b59559-4110-4bf6-ba0e-93534705f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9511056-66a4-4e6b-9841-577219cde5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9511056-66a4-4e6b-9841-577219cde5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8558861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d115d023-9326-4438-9643-9c7f81437389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492bf52c-05ce-4a61-9e76-9ef7f037303a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492bf52c-05ce-4a61-9e76-9ef7f037303a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d522cac0-d0c5-440b-ac9f-7b5ab36e0410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d522cac0-d0c5-440b-ac9f-7b5ab36e0410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd115d023-9326-4438-9643-9c7f81437389', 'volume_name': 'volume-d115d023-9326-4438-9643-9c7f81437389', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955afda3-6d9f-4bb7-b7c9-7184ce6308dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955afda3-6d9f-4bb7-b7c9-7184ce6308dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bedd59f-e0a7-4c7c-b409-dfcfbda71238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:25 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume d115d023-9326-4438-9643-9c7f81437389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d115d023-9326-4438-9643-9c7f81437389', 'volume_size': 1}
Apr 29 08:45:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (e1dd540f-ffea-4255-a34a-03668d078669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e303d67-a1c0-4de4-9a74-1f4fb8e9472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Flow 'volume_create_manager' (b6998188-37a4-4fc0-a470-db3e815b610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76088f69-c18b-4e0f-aed3-1822d52e0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e303d67-a1c0-4de4-9a74-1f4fb8e9472a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1796242978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb2e68e-d3bc-444a-bc39-5d669da53d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c102861-5d5c-44c6-af06-31d636d25d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c102861-5d5c-44c6-af06-31d636d25d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea5e957-4996-4be2-81fd-dc90001ba323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea5e957-4996-4be2-81fd-dc90001ba323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb2e68e-d3bc-444a-bc39-5d669da53d9f', 'volume_name': 'volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34524cb9-599d-4127-aa80-1e50ca3a412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34524cb9-599d-4127-aa80-1e50ca3a412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e76043-f1d9-407e-9dee-77e96ce5c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume 2cb2e68e-d3bc-444a-bc39-5d669da53d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f', 'volume_size': 1}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:26 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76088f69-c18b-4e0f-aed3-1822d52e0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-447395850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc1145f-b69f-4ad4-bfdd-e8a85f916a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded84ee3655c481392493d6dca0268fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='9d208bb1706942cda29de87a859da94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aef171-2ede-41be-b70b-ba6d83a736be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0aef171-2ede-41be-b70b-ba6d83a736be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779391df-88ad-44f5-b65f-e68151a0ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779391df-88ad-44f5-b65f-e68151a0ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc1145f-b69f-4ad4-bfdd-e8a85f916a71', 'volume_name': 'volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0341dd03-bbad-498d-b71e-ae612e1f6328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0341dd03-bbad-498d-b71e-ae612e1f6328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5599072-cfc4-4ee2-8e40-a7a88a0a3a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Volume bcc1145f-b69f-4ad4-bfdd-e8a85f916a71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71', 'volume_size': 1}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 1073741824" returned: 0 in 1.169s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (bcd38416-f2e9-4227-8613-2ea102048e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a029aa-18b6-4fd4-91fd-41c45140a0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a029aa-18b6-4fd4-91fd-41c45140a0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519556755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aee8c78-f6e0-46c5-b5c7-d53466ccf137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20926b0-ef59-45f7-bc45-3835f1d3a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20926b0-ef59-45f7-bc45-3835f1d3a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58369b3d-caf9-4a24-8bd9-f3766139cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58369b3d-caf9-4a24-8bd9-f3766139cb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aee8c78-f6e0-46c5-b5c7-d53466ccf137', 'volume_name': 'volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b214b4b-a135-4b7c-a4c8-956029fe73d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b214b4b-a135-4b7c-a4c8-956029fe73d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68474b-1c72-4afa-898c-377b28bdbe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:26 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume 6aee8c78-f6e0-46c5-b5c7-d53466ccf137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137', 'volume_size': 1}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:26 devstack sudo[92571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721
Apr 29 08:45:26 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:27 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.752s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844584932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff7caf3-fd67-4298-ac9a-9834c168441e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:21Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Creating volume eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:27 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e234c179-5782-4016-b1bb-ec1a401b37d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:27 devstack sudo[92574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e 1073741824
Apr 29 08:45:27 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79bda4-ed89-4069-914f-3a4a120e0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:27 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Volume volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 (47cc64f9-b8d1-43a8-9a0d-78390aa11721): created successfully
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff79bda4-ed89-4069-914f-3a4a120e0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:27 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (c7afdd78-87c3-4ad0-8348-4abf3f9b6b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e1b1dda6-d3de-4bda-93fd-13406b4c3fe3 tempest-CreateVolumesFromImageTest-2009772737 None] Created volume successfully.
Apr 29 08:45:28 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e 1073741824" returned: 0 in 0.860s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:28 devstack sudo[92579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:45:28 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:28 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.581s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.943s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614503266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8b4822-adfc-401c-8c4f-286f34745011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:22Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Creating volume ad8b4822-adfc-401c-8c4f-286f34745011 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:28 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:28 devstack sudo[92582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 1073741824
Apr 29 08:45:28 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8fd2343-80a7-4f3c-8a83-c25e301946b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff7caf3-fd67-4298-ac9a-9834c168441e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec4251d-4d58-4208-b1e7-a8eeb9eb3d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:28 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Volume volume-eff7caf3-fd67-4298-ac9a-9834c168441e (eff7caf3-fd67-4298-ac9a-9834c168441e): created successfully
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec4251d-4d58-4208-b1e7-a8eeb9eb3d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:28 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (13e6a2a5-deac-4588-977d-74beb88d42b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:28 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-534b106c-f35c-4f44-bc9f-93c0e268d99e tempest-VolumeDependencyTests-2000884199 None] Created volume successfully.
Apr 29 08:45:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:29 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 1073741824" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:29 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011
Apr 29 08:45:29 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:30 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011" returned: 0 in 0.656s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.113s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791177674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a6af43-feef-4b28-a9f1-9af39b3d707b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:22Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Creating volume 37a6af43-feef-4b28-a9f1-9af39b3d707b {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:30 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2c43de-731c-4b2c-b69e-e81788283994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8b4822-adfc-401c-8c4f-286f34745011', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86470f62-ca74-426c-825d-e16839ca505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:30 devstack sudo[92591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b 1073741824
Apr 29 08:45:30 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:30 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Volume volume-ad8b4822-adfc-401c-8c4f-286f34745011 (ad8b4822-adfc-401c-8c4f-286f34745011): created successfully
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86470f62-ca74-426c-825d-e16839ca505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:30 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (d1a8c0df-bc88-44c2-afbf-48e8ffc31bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9803b5e8-55c9-402d-8a70-d9befe6395c9 tempest-CreateVolumesFromImageTest-2009772737 None] Created volume successfully.
Apr 29 08:45:31 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b 1073741824" returned: 0 in 0.886s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:31 devstack sudo[92598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b
Apr 29 08:45:31 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:31 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b" returned: 0 in 0.625s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.208s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241374900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082ef521-6db3-4b7b-98e0-893011869cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6012e222d21047a9967e52bf67246bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:23Z,use_quota=True,user_id='8163f7adf4e6453db30e8d34056e32cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Creating volume 082ef521-6db3-4b7b-98e0-893011869cb5 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:31 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616425d8-564e-4e68-affc-8752ae465c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a6af43-feef-4b28-a9f1-9af39b3d707b', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:31 devstack sudo[92601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 1073741824
Apr 29 08:45:31 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e35ce63-8eb8-4487-af46-71c28d97ef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:31 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Volume volume-37a6af43-feef-4b28-a9f1-9af39b3d707b (37a6af43-feef-4b28-a9f1-9af39b3d707b): created successfully
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e35ce63-8eb8-4487-af46-71c28d97ef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:31 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (fe53f4a9-bfe0-4fae-be69-c38efce64a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:31 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-cb3f6416-c57c-4086-bf7b-8dab109a3b01 tempest-CreateVolumesFromImageTest-2009772737 None] Created volume successfully.
Apr 29 08:45:32 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 1073741824" returned: 0 in 0.825s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:32 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:32 devstack sudo[92607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5
Apr 29 08:45:32 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:33 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5" returned: 0 in 0.637s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.460s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1485230138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2157f7-a366-47f8-8b02-9f4dc9c3d04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume 2b2157f7-a366-47f8-8b02-9f4dc9c3d04e {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:33 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6af6249-fe8c-4bae-8442-f57c449b5999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082ef521-6db3-4b7b-98e0-893011869cb5', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:33 devstack sudo[92610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e 1073741824
Apr 29 08:45:33 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323ff7f-3778-4765-afbb-02ef6f27bcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:33 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Volume volume-082ef521-6db3-4b7b-98e0-893011869cb5 (082ef521-6db3-4b7b-98e0-893011869cb5): created successfully
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323ff7f-3778-4765-afbb-02ef6f27bcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Flow 'volume_create_manager' (0137d8bb-cac6-4e81-8331-59b3b8779999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:33 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9fe9c50b-3caa-4153-8466-ec8efc53ec41 tempest-CreateVolumesFromImageTest-2009772737 None] Created volume successfully.
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-082ef521-6db3-4b7b-98e0-893011869cb5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-082ef521-6db3-4b7b-98e0-893011869cb5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-quobyte-082ef521-6db3-4b7b-98e0-893011869cb5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-082ef521-6db3-4b7b-98e0-893011869cb5" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a57bdf9-2f22-48cf-9c1f-fbadc541eb9d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:33 devstack sudo[92612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5
Apr 29 08:45:33 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:34 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e 1073741824" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:34 devstack sudo[92617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e
Apr 29 08:45:34 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:34 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5" returned: 0 in 0.776s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:34 devstack sudo[92622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5
Apr 29 08:45:34 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:34 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" returned: 0 in 0.648s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.644s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881376061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec693284-83a5-4dda-9429-098cdf1a89c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume ec693284-83a5-4dda-9429-098cdf1a89c4 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:34 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:34 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 1073741824
Apr 29 08:45:34 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e4e190-cce0-4850-bf5f-661909afd1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4c0462-4ef4-4a9e-8bac-8cf72da96ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:34 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e (2b2157f7-a366-47f8-8b02-9f4dc9c3d04e): created successfully
Apr 29 08:45:34 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4c0462-4ef4-4a9e-8bac-8cf72da96ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (d317d005-35da-435c-82cd-9b664e42b1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-80282a7c-e52f-4089-a2af-d7caf02a9c50 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:35 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-082ef521-6db3-4b7b-98e0-893011869cb5" returned: 0 in 0.635s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-082ef521-6db3-4b7b-98e0-893011869cb5" released by "delete_volume" :: held 1.457s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Created reservations ['e4e51003-70a2-4d27-8324-6434cf6c10ab', '4c527087-94a7-4d1e-b97b-3c7eded080d6', '38a73490-22ba-4486-8f2f-267b7292cf08', 'c8cbdad6-340d-4021-96fc-669fb93d6bab'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:35 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:35 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:35 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 1073741824" returned: 0 in 0.863s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:35 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4
Apr 29 08:45:35 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-37a6af43-feef-4b28-a9f1-9af39b3d707b-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:35 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.633s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:35 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Deleted volume successfully.
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-37a6af43-feef-4b28-a9f1-9af39b3d707b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b6fdb692-96f4-43d9-a839-a7794e0714de tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-082ef521-6db3-4b7b-98e0-893011869cb5-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-quobyte-37a6af43-feef-4b28-a9f1-9af39b3d707b" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-37a6af43-feef-4b28-a9f1-9af39b3d707b" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28ef07-c4ca-443a-bdfc-695b1440eb7a]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:36 devstack sudo[92637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b
Apr 29 08:45:36 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:36 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4" returned: 0 in 0.740s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.916s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-8558861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d115d023-9326-4438-9643-9c7f81437389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:25Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume d115d023-9326-4438-9643-9c7f81437389 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:36 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d977d76c-82c1-4c3c-b3a3-32835a840059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec693284-83a5-4dda-9429-098cdf1a89c4', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:36 devstack sudo[92640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 1073741824
Apr 29 08:45:36 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a4273-011d-4e25-9d24-9c75e10e4a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:36 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-ec693284-83a5-4dda-9429-098cdf1a89c4 (ec693284-83a5-4dda-9429-098cdf1a89c4): created successfully
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a4273-011d-4e25-9d24-9c75e10e4a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (b0e0784d-5700-4b5c-9f62-4ee2ae50f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:36 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d7920ff0-7543-4028-9a07-59b9297fb839 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:36 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b" returned: 0 in 0.791s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:36 devstack sudo[92645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b
Apr 29 08:45:36 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:37 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 1073741824" returned: 0 in 0.820s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:37 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389
Apr 29 08:45:37 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:37 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-37a6af43-feef-4b28-a9f1-9af39b3d707b" returned: 0 in 0.658s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-37a6af43-feef-4b28-a9f1-9af39b3d707b" released by "delete_volume" :: held 1.490s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Created reservations ['6da4f143-ccc1-4ea2-9ece-4ccbe4153b95', 'f37e5dfc-1e06-40ac-816f-6f002983d96d', '8b6c4bf1-3cf5-4682-8f9b-5938592a80b2', '32d53926-e7bb-4e8a-b2c9-1e50447071d4'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:37 devstack sudo[92653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:37 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:38 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389" returned: 0 in 0.634s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.651s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1796242978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb2e68e-d3bc-444a-bc39-5d669da53d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume 2cb2e68e-d3bc-444a-bc39-5d669da53d9f {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:38 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:38 devstack sudo[92656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f 1073741824
Apr 29 08:45:38 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bedd59f-e0a7-4c7c-b409-dfcfbda71238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d115d023-9326-4438-9643-9c7f81437389', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020f94bc-3981-4aad-a66a-afc8c51c3400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:38 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-d115d023-9326-4438-9643-9c7f81437389 (d115d023-9326-4438-9643-9c7f81437389): created successfully
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020f94bc-3981-4aad-a66a-afc8c51c3400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (85b59559-4110-4bf6-ba0e-93534705f644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:38 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3f13aec1-311a-4e3c-924e-e519b5ec4031 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-ad8b4822-adfc-401c-8c4f-286f34745011-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-ad8b4822-adfc-401c-8c4f-286f34745011-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-quobyte-ad8b4822-adfc-401c-8c4f-286f34745011" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:38 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-ad8b4822-adfc-401c-8c4f-286f34745011" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.686s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:38 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Deleted volume successfully.
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd04a32-c4cc-4995-8604-7a6ee9d21f8e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-2b966181-9b67-426a-b68a-df584eb06282 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-37a6af43-feef-4b28-a9f1-9af39b3d707b-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:38 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011
Apr 29 08:45:38 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:38 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f 1073741824" returned: 0 in 0.858s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:39 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f
Apr 29 08:45:39 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:39 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011" returned: 0 in 0.813s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:39 devstack sudo[92669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011
Apr 29 08:45:39 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:39 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" returned: 0 in 0.646s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.154s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-447395850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc1145f-b69f-4ad4-bfdd-e8a85f916a71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ded84ee3655c481392493d6dca0268fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='9d208bb1706942cda29de87a859da94d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Creating volume bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:39 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:39 devstack sudo[92672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 1073741824
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e76043-f1d9-407e-9dee-77e96ce5c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:39 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e888ccfe-44d2-4563-aad3-c0f3a04f906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:39 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f (2cb2e68e-d3bc-444a-bc39-5d669da53d9f): created successfully
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e888ccfe-44d2-4563-aad3-c0f3a04f906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (e1dd540f-ffea-4255-a34a-03668d078669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:39 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-381df19d-b47d-47f3-8f75-a28f3a972746 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:39 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ad8b4822-adfc-401c-8c4f-286f34745011" returned: 0 in 0.668s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-ad8b4822-adfc-401c-8c4f-286f34745011" released by "delete_volume" :: held 1.534s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:39 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Created reservations ['eecc3291-588c-42c2-bcc8-56ab3cad4728', 'e0f53b54-773b-4320-aeef-4efde1705c45', 'e9d7c455-ab14-4b29-b572-a035d96dd6ef', '41f950f8-d8ff-4522-a093-fcca62733842'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:40 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:40 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:40 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 1073741824" returned: 0 in 0.780s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:40 devstack sudo[92680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71
Apr 29 08:45:40 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-47cc64f9-b8d1-43a8-9a0d-78390aa11721-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-47cc64f9-b8d1-43a8-9a0d-78390aa11721-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-quobyte-47cc64f9-b8d1-43a8-9a0d-78390aa11721" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-47cc64f9-b8d1-43a8-9a0d-78390aa11721" acquired by "delete_volume" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[808645ec-8fb1-4482-bf37-1ff2cc520a09]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:40 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.737s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Deleted volume successfully.
Apr 29 08:45:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-c38455b2-0e96-4f4f-9107-62328f9ad379 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-ad8b4822-adfc-401c-8c4f-286f34745011-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:40 devstack sudo[92684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721
Apr 29 08:45:40 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:41 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" returned: 0 in 0.741s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.643s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519556755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aee8c78-f6e0-46c5-b5c7-d53466ccf137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2ab1dd9b87444679b68733b126a3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:26Z,use_quota=True,user_id='7577b9599b5b41679886afa3302b46bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Creating volume 6aee8c78-f6e0-46c5-b5c7-d53466ccf137 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:41 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:41 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 1073741824
Apr 29 08:45:41 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5599072-cfc4-4ee2-8e40-a7a88a0a3a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c04a389-6362-49e0-99d1-877f5d41761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:41 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Volume volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 (bcc1145f-b69f-4ad4-bfdd-e8a85f916a71): created successfully
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c04a389-6362-49e0-99d1-877f5d41761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Flow 'volume_create_manager' (b6998188-37a4-4fc0-a470-db3e815b610c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:41 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b5a6f74e-3cc6-434a-be5b-4853b22349db tempest-CinderUnicodeTest-25332696 None] Created volume successfully.
Apr 29 08:45:41 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721" returned: 0 in 0.738s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:41 devstack sudo[92692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721
Apr 29 08:45:41 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:42 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-47cc64f9-b8d1-43a8-9a0d-78390aa11721" returned: 0 in 0.616s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:42 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-47cc64f9-b8d1-43a8-9a0d-78390aa11721" released by "delete_volume" :: held 1.407s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 1073741824" returned: 0 in 0.836s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:42 devstack sudo[92698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137
Apr 29 08:45:42 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Created reservations ['da49a98f-c5d1-4e71-a33d-9d7e285fa0d6', '73a8d031-1ea5-409c-9323-1ed5da16e58b', 'f681750b-794e-4648-98f6-6a0ea572d8dd', '4d7ea9dc-29ae-490c-a979-8c1170d2d6e1'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:42 devstack sudo[92700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:42 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:42 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" returned: 0 in 0.618s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.363s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Creating offline snapshot 01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 of volume eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68474b-1c72-4afa-898c-377b28bdbe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ffdc80-3ad9-4c73-8a6f-cc5f1e7b8c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e20ef-7d9d-46e2-b008-2b689d81f9f0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-2e6003fb-e457-42f1-b250-55984bb9598c-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:42 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Volume volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 (6aee8c78-f6e0-46c5-b5c7-d53466ccf137): created successfully
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ffdc80-3ad9-4c73-8a6f-cc5f1e7b8c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Flow 'volume_create_manager' (bcd38416-f2e9-4227-8613-2ea102048e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-2e6003fb-e457-42f1-b250-55984bb9598c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b0cd6c33-9aab-4fef-96fa-2073e9c10edc tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created volume successfully.
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "cinder-quobyte-2e6003fb-e457-42f1-b250-55984bb9598c" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:42 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.723s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-2e6003fb-e457-42f1-b250-55984bb9598c" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:42 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Deleted volume successfully.
Apr 29 08:45:43 devstack sudo[92704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:45:43 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04952ee8-ef1c-4423-8805-2bf198d6120e]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e71880ba-a03d-4acd-9bbd-0acafc9f7489 tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-47cc64f9-b8d1-43a8-9a0d-78390aa11721-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:43 devstack sudo[92706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c
Apr 29 08:45:43 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:43 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.845s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:43 devstack sudo[92714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 1G
Apr 29 08:45:43 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:43 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c" returned: 0 in 0.733s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:43 devstack sudo[92716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c
Apr 29 08:45:43 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-6aee8c78-f6e0-46c5-b5c7-d53466ccf137-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-6aee8c78-f6e0-46c5-b5c7-d53466ccf137-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa01b97-0b87-4596-a1f5-c4c64d9714b2]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:44 devstack sudo[92718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137
Apr 29 08:45:44 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:44 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2e6003fb-e457-42f1-b250-55984bb9598c" returned: 0 in 0.699s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-quobyte-2e6003fb-e457-42f1-b250-55984bb9598c" released by "delete_volume" :: held 1.477s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Created reservations ['ab1afc15-0afa-43d3-8c41-a8b31b6d0003', '9f995118-dffa-45a7-af69-63c20d0742db', 'fef95011-9c96-4b85-bc16-503e5db51fee', 'ad03d688-fb60-4f9a-a6fa-d81cd1aaa654'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:44 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 1G" returned: 0 in 0.848s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff7caf3-fd67-4298-ac9a-9834c168441e -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:44 devstack sudo[92725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff7caf3-fd67-4298-ac9a-9834c168441e -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:45:44 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:44 devstack sudo[92727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:44 devstack sudo[92727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:44 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" returned: 0 in 0.773s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:44 devstack sudo[92733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137
Apr 29 08:45:44 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:45 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff7caf3-fd67-4298-ac9a-9834c168441e -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.676s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:45 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 is being set with open permissions: ugo+rw
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:45 devstack sudo[92741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:45:45 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:45 devstack sudo[92727]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.672s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:45 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Deleted volume successfully.
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-22c7ee97-e6d6-4a7e-a222-ef96842aa85f tempest-CreateVolumesFromImageTest-2009772737 None] Lock "cinder-2e6003fb-e457-42f1-b250-55984bb9598c-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:45 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" returned: 0 in 0.679s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-6aee8c78-f6e0-46c5-b5c7-d53466ccf137" released by "delete_volume" :: held 1.511s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['3ee963b0-9ac0-44a7-a450-492402a7fad4', '4c247c92-ce8a-473b-ae4b-8414f064c75c', 'e450bfa1-95b8-40ab-866f-da516c1c41db', '88eeebc5-e12e-4072-8b61-cfa481c1d9f2'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:45 devstack sudo[92745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:45 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:45 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.687s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:45 devstack sudo[92747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info
Apr 29 08:45:45 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-2cb2e68e-d3bc-444a-bc39-5d669da53d9f-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-2cb2e68e-d3bc-444a-bc39-5d669da53d9f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641c060-21da-41e1-9b9b-d7d40599b0c4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:46 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.810s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-a9f2d9f4-ecb3-4e62-90a1-4d6c928727cd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-6aee8c78-f6e0-46c5-b5c7-d53466ccf137-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:46 devstack sudo[92750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f
Apr 29 08:45:46 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:46 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info" returned: 0 in 0.809s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:46 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info is being set with open permissions: ugo+rw
Apr 29 08:45:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:46 devstack sudo[92753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info
Apr 29 08:45:46 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:47 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.info" returned: 0 in 0.773s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:47 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.775s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.089s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" returned: 0 in 1.042s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Creating offline snapshot 1786785a-eb76-45e9-8a13-a0791a189b32 of volume bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:45:47 devstack sudo[92761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f
Apr 29 08:45:47 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-40ced0c9-1c4b-426d-9514-775cf483551a tempest-VolumeDependencyTests-2000884199 None] Create snapshot completed successfully
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a482083-0e07-48c3-b67e-483d9b60cbef]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:47 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71
Apr 29 08:45:47 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:48 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" returned: 0 in 0.651s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-2cb2e68e-d3bc-444a-bc39-5d669da53d9f" released by "delete_volume" :: held 1.763s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['41a5e26e-08e0-4316-a6c5-ec9633d1f20e', '4dc3847e-0aa8-4b7a-98a5-e5058c8effee', '891cf68f-4490-4d44-8ed9-caff4d0a8f0d', '22db9bf0-95ef-4ddb-a1d2-081077aa1184'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:48 devstack sudo[92770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:48 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:48 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" returned: 0 in 1.002s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:48 devstack sudo[92773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 1G
Apr 29 08:45:48 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-d115d023-9326-4438-9643-9c7f81437389-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-d115d023-9326-4438-9643-9c7f81437389-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-d115d023-9326-4438-9643-9c7f81437389" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-d115d023-9326-4438-9643-9c7f81437389" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[33760a09-393b-4d97-ae40-8491cd8c49e9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:48 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (d01e32c3-393e-483e-bb72-61098e3d267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e169b3-a4d3-4c26-9dd5-ac4d09008529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e169b3-a4d3-4c26-9dd5-ac4d09008529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225801647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e2dd26-bf1f-4e02-8f76-3d25355095dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:49Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac90839-ef3d-4d83-9461-929ae0d60a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac90839-ef3d-4d83-9461-929ae0d60a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab186ad-15fa-4cf7-b6dd-bdcf12b4f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab186ad-15fa-4cf7-b6dd-bdcf12b4f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e2dd26-bf1f-4e02-8f76-3d25355095dd', 'volume_name': 'volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227f98fe-7e6a-4b56-9f74-31ebc1d1ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (227f98fe-7e6a-4b56-9f74-31ebc1d1ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a7e43-69a0-4584-8f61-2d65cae93066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume c8e2dd26-bf1f-4e02-8f76-3d25355095dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd', 'volume_size': 1}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:49 devstack sudo[92775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:45:49 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (16560ecf-d81d-4282-8128-c041b96c07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ec245e-136b-40b0-9642-bb1f9b2c263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ec245e-136b-40b0-9642-bb1f9b2c263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-219858463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f50fd4b-e3b0-43db-8282-2e4b46752608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01b37f9e-5367-4ce9-81f2-b2c4d1bb1786,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:49Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f252f50-d559-4be6-b916-6a3118da19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f252f50-d559-4be6-b916-6a3118da19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa42713-cc11-435f-82b9-9883dcd8a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa42713-cc11-435f-82b9-9883dcd8a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f50fd4b-e3b0-43db-8282-2e4b46752608', 'volume_name': 'volume-7f50fd4b-e3b0-43db-8282-2e4b46752608', 'volume_size': 1, 'snapshot_id': '01b37f9e-5367-4ce9-81f2-b2c4d1bb1786'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce431b41-6ee9-4469-bac0-3c73cb07d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce431b41-6ee9-4469-bac0-3c73cb07d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3fd998-3f91-44f4-9599-02c242aa7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Volume 7f50fd4b-e3b0-43db-8282-2e4b46752608: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f50fd4b-e3b0-43db-8282-2e4b46752608', 'volume_size': 1, 'snapshot_id': '01b37f9e-5367-4ce9-81f2-b2c4d1bb1786'}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:49 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.008s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:49 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-397fe404-6eca-4a4f-a03f-ffa12dcd9e9c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-2cb2e68e-d3bc-444a-bc39-5d669da53d9f-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:49 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 1G" returned: 0 in 1.064s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:49 devstack sudo[92782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32
Apr 29 08:45:49 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:49 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389" returned: 0 in 0.887s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:49 devstack sudo[92786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389
Apr 29 08:45:49 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:50 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32" returned: 0 in 0.619s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:50 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 is being set with open permissions: ugo+rw
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:50 devstack sudo[92791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32
Apr 29 08:45:50 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:50 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-d115d023-9326-4438-9643-9c7f81437389" returned: 0 in 0.604s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-d115d023-9326-4438-9643-9c7f81437389" released by "delete_volume" :: held 1.560s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['ca90fe02-9114-4219-839b-5f638e147dff', 'd943835f-dd5f-4f87-b8ea-e3139fb1d04e', '181c7e55-8f41-4ddd-bacb-fb132de70607', '412dba2e-8efc-431f-bdec-e65da72a2700'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:50 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:50 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:50 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32" returned: 0 in 0.659s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-ec693284-83a5-4dda-9429-098cdf1a89c4-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:51 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info
Apr 29 08:45:51 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-ec693284-83a5-4dda-9429-098cdf1a89c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-ec693284-83a5-4dda-9429-098cdf1a89c4" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-ec693284-83a5-4dda-9429-098cdf1a89c4" acquired by "delete_volume" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c687f58-0acd-4634-a3ca-4ecdaca43e58]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:51 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.639s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:51 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-aef71277-027d-4925-95cb-f64f1f061657 tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-d115d023-9326-4438-9643-9c7f81437389-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:51 devstack sudo[92801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4
Apr 29 08:45:51 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:51 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info" returned: 0 in 0.645s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:51 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info is being set with open permissions: ugo+rw
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:51 devstack sudo[92806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info
Apr 29 08:45:51 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:51 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4" returned: 0 in 0.725s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:51 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:51 devstack sudo[92811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4
Apr 29 08:45:51 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:52 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.info" returned: 0 in 0.610s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.765s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-225801647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e2dd26-bf1f-4e02-8f76-3d25355095dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:45:49Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:52 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:52 devstack sudo[92814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd 1073741824
Apr 29 08:45:52 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:52 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-52477163-5ded-4dd7-bc1e-326513ea5cc2 tempest-CinderUnicodeTest-25332696 None] Create snapshot completed successfully
Apr 29 08:45:52 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-ec693284-83a5-4dda-9429-098cdf1a89c4" returned: 0 in 0.586s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-ec693284-83a5-4dda-9429-098cdf1a89c4" released by "delete_volume" :: held 1.361s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['bb8bd3ef-ce16-423a-963d-53f2bc295d5c', '74149830-8ac4-4527-8ab6-dbad9b5329f8', 'ab2496a7-e501-4523-a266-7f4e6c70ec7d', 'eaab8803-7fa4-44c1-82d6-1f0f7ba91122'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:52 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:52 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:52 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-1786785a-eb76-45e9-8a13-a0791a189b32-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-1786785a-eb76-45e9-8a13-a0791a189b32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-quobyte-1786785a-eb76-45e9-8a13-a0791a189b32" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-1786785a-eb76-45e9-8a13-a0791a189b32" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Deleting offline snapshot 1786785a-eb76-45e9-8a13-a0791a189b32 of volume bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] snapshot_file for this snap is: volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd3ab1-851b-4468-9844-6fbfe13604e4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:53 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32
Apr 29 08:45:53 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:53 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd 1073741824" returned: 0 in 0.926s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:53 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.639s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:53 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-4e0b32d2-1f69-4772-8fdd-f2f68e91e2fd tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-ec693284-83a5-4dda-9429-098cdf1a89c4-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:53 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd
Apr 29 08:45:53 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365266c-7268-4134-9c76-cefa7743abe9]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:53 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e
Apr 29 08:45:53 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:53 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32" returned: 0 in 0.773s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17444ff0-6be3-4963-a1be-754ca954193f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" returned: 0 in 0.667s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:53 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.704s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:53 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-7f50fd4b-e3b0-43db-8282-2e4b46752608" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-7f50fd4b-e3b0-43db-8282-2e4b46752608" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Creating volume 7f50fd4b-e3b0-43db-8282-2e4b46752608 from snapshot 01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:54 devstack sudo[92833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71
Apr 29 08:45:54 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705a7e43-69a0-4584-8f61-2d65cae93066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0918afed-20cf-4c0c-bd5f-fa34ec3c496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:45:54 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd (c8e2dd26-bf1f-4e02-8f76-3d25355095dd): created successfully
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0918afed-20cf-4c0c-bd5f-fa34ec3c496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (d01e32c3-393e-483e-bb72-61098e3d267b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" acquired by "_copy_volume_from_snapshot" :: waited 0.064s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] snapshot: 01b37f9e-5367-4ce9-81f2-b2c4d1bb1786, volume: 7f50fd4b-e3b0-43db-8282-2e4b46752608,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:45:54 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d4aec09b-a0d2-42f3-abae-d2189d5b95bd tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e53feb7-0dfc-469a-bc01-a3832505bbcd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:54 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:45:54 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:54 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" returned: 0 in 0.895s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:54 devstack sudo[92840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e
Apr 29 08:45:54 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:54 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" returned: 0 in 0.861s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:54 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32
Apr 29 08:45:54 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:54 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.752s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff7caf3-fd67-4298-ac9a-9834c168441e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa41a53-4043-4162-a787-2db1a66818f3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:54 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" returned: 0 in 0.611s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e" released by "delete_volume" :: held 1.563s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:55 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:45:55 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['f3a0d045-66ac-4a11-a5c4-4c7e3c79fa12', '8f2fe8ca-0685-49ff-a279-09c7dd370cc4', 'ae5b9ab6-68ac-408d-87df-fe71d8643b73', 'a7bcbb05-7c4b-4fe8-8d48-d982716f0c41'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:55 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:55 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32" returned: 0 in 0.803s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32
Apr 29 08:45:55 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-0e91a8e7-e820-42b5-98f6-31cd55127e38-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-0e91a8e7-e820-42b5-98f6-31cd55127e38-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "cinder-quobyte-0e91a8e7-e820-42b5-98f6-31cd55127e38" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-0e91a8e7-e820-42b5-98f6-31cd55127e38" acquired by "delete_volume" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e184a674-4c58-4fd8-aa71-90e1c6dee504]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.899s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:45:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:55 devstack sudo[92868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608
Apr 29 08:45:55 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:55 devstack sudo[92867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38
Apr 29 08:45:55 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:56 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:45:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-58aac6df-db68-40b4-afbf-ef8154f7d5ce tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-2b2157f7-a366-47f8-8b02-9f4dc9c3d04e-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:56 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71.1786785a-eb76-45e9-8a13-a0791a189b32" returned: 0 in 0.708s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-1786785a-eb76-45e9-8a13-a0791a189b32" released by "_delete_snapshot" :: held 3.279s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" released by "delete_snapshot" :: held 3.310s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Created reservations ['edddb969-b737-4393-8358-4faf22d88e6d', '3468aa13-2ddb-4ded-916d-e1edaf2a5c01', '8ce44a16-05e8-47ce-8b56-9b4fd308eb12', '875fc1b0-97fd-4714-8d43-d5a6665c54b0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:56 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Delete snapshot completed successfully.
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-9fe88d64-039a-4dce-9430-2a6087dd0471 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-1786785a-eb76-45e9-8a13-a0791a189b32-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:56 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38" returned: 0 in 0.865s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:56 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38
Apr 29 08:45:56 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" acquired by "delete_volume" :: waited 0.058s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e14a3b-ba12-4c35-a79b-46407de8bdcd]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:45:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:58 devstack sudo[92889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71
Apr 29 08:45:58 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:58 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-0e91a8e7-e820-42b5-98f6-31cd55127e38" returned: 0 in 1.546s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-quobyte-0e91a8e7-e820-42b5-98f6-31cd55127e38" released by "delete_volume" :: held 2.497s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Created reservations ['ea82ca34-da84-4cbd-80c3-ed538a57c45b', '43e99fe1-a98e-4688-b363-9e7fac7fee36', '1ccf8982-7831-4874-8fa5-9cdf5959b66a', 'cb1a1f76-16b3-4fa7-bd0f-fb6d25ad0ee0'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:45:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:58 devstack sudo[92892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:45:58 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:45:59 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root
Apr 29 08:45:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" returned: 0 in 2.142s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:45:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:45:59 devstack sudo[92931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71
Apr 29 08:45:59 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:00 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.697s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:00 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Deleted volume successfully.
Apr 29 08:46:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-833d2415-9b6e-447b-85ec-66809e7cef1c tempest-CreateVolumesFromSourceVolumeTest-1276939100 None] Lock "cinder-0e91a8e7-e820-42b5-98f6-31cd55127e38-delete_volume" released by "delete_volume" :: held 4.746s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:01 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608" returned: 0 in 5.792s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024967e-ae58-4a4c-a0e3-a732df5c7081]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:01 devstack sudo[92937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:46:01 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:01 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" returned: 0 in 1.946s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71" released by "delete_volume" :: held 4.208s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:01 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Created reservations ['65f72117-7081-4e12-9222-8a27005150ee', '4e296ed4-5bfa-4698-b9c4-8ac1362dc65c', '9cc152dc-e20c-45af-902c-46767ab348e7', '003861f3-0f9d-4503-adf6-a25b96883ad8'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:02 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:02 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-9a02a762-ec40-4bb0-a508-20c96efa463d-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "cinder-9a02a762-ec40-4bb0-a508-20c96efa463d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Acquiring lock "cinder-quobyte-9a02a762-ec40-4bb0-a508-20c96efa463d" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-9a02a762-ec40-4bb0-a508-20c96efa463d" acquired by "delete_volume" :: waited 0.035s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f2573-daa3-45db-97ed-40efb4c2ffc0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:02 devstack sudo[92946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d
Apr 29 08:46:02 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:02 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 1.159s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:46:02 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Converted 1024.00 MB image at 176.73 MB/s
Apr 29 08:46:02 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 is being set with open permissions: ugo+rw
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:02 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608
Apr 29 08:46:02 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:02 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.806s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:02 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Deleted volume successfully.
Apr 29 08:46:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5b906544-1e9e-4647-a33a-87c138c51019 tempest-CinderUnicodeTest-25332696 None] Lock "cinder-bcc1145f-b69f-4ad4-bfdd-e8a85f916a71-delete_volume" released by "delete_volume" :: held 5.435s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:03 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d" returned: 0 in 0.834s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:03 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d
Apr 29 08:46:03 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:03 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608" returned: 0 in 0.646s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" released by "_copy_volume_from_snapshot" :: held 9.398s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-7f50fd4b-e3b0-43db-8282-2e4b46752608" released by "_create_volume_from_snapshot" :: held 9.486s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.514s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.946s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating offline snapshot d64bd62a-6309-426b-b14e-6d10fb279c73 of volume c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[039de29b-9350-4091-8459-9e5730552675]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3fd998-3f91-44f4-9599-02c242aa7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f50fd4b-e3b0-43db-8282-2e4b46752608', 'volume_size': 1, 'snapshot_id': '01b37f9e-5367-4ce9-81f2-b2c4d1bb1786'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44807061-ee9d-41c4-a942-e827cc40a563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:03 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Volume volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 (7f50fd4b-e3b0-43db-8282-2e4b46752608): created successfully
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44807061-ee9d-41c4-a942-e827cc40a563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (16560ecf-d81d-4282-8128-c041b96c07d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-d5b3da7b-7ccc-4db9-afe8-1d6cade84063 tempest-VolumeDependencyTests-2000884199 None] Created volume successfully.
Apr 29 08:46:03 devstack sudo[92959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd
Apr 29 08:46:03 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:03 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-9a02a762-ec40-4bb0-a508-20c96efa463d" returned: 0 in 0.617s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "cinder-quobyte-9a02a762-ec40-4bb0-a508-20c96efa463d" released by "delete_volume" :: held 1.518s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Created reservations ['4d91fc49-e328-487d-b820-d1cff5a36e9f', 'ee2eec28-9b6e-43fe-ac71-15b85f1b3cfd', 'c80c5335-0e1e-47be-aa93-5ebfba6652e0', 'c295662f-6110-4dcc-a5ca-6ea25e8cc8fa'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:04 devstack sudo[92962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:04 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:04 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" returned: 0 in 0.815s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:04 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 1G
Apr 29 08:46:04 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Deleting offline snapshot 01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 of volume eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] snapshot_file for this snap is: volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dbf622-81b5-4810-a122-a7012cf79ce6]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:04 devstack sudo[92969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:46:04 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:04 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.741s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:04 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Deleted volume successfully.
Apr 29 08:46:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-15b7bf8c-5b90-482e-a404-490c985d004c tempest-CinderUnicodeTest-25332696 None] Lock "cinder-9a02a762-ec40-4bb0-a508-20c96efa463d-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:05 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.813s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff7caf3-fd67-4298-ac9a-9834c168441e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58da9e2-e6d5-42ec-8012-79d0d5933ade]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:05 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 1G" returned: 0 in 0.986s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:05 devstack sudo[92980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73
Apr 29 08:46:05 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:05 devstack sudo[92979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:46:05 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:06 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73" returned: 0 in 0.829s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:06 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 is being set with open permissions: ugo+rw
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:06 devstack sudo[92989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73
Apr 29 08:46:06 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:06 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.905s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:06 devstack sudo[92991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:46:06 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:06 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73" returned: 0 in 0.716s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:06 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:06 devstack sudo[92998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info
Apr 29 08:46:07 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:07 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.781s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:07 devstack sudo[93000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786
Apr 29 08:46:07 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:07 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info" returned: 0 in 0.698s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:07 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info is being set with open permissions: ugo+rw
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:07 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info
Apr 29 08:46:07 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:07 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e.01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" returned: 0 in 0.658s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786" released by "_delete_snapshot" :: held 3.291s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" released by "delete_snapshot" :: held 3.324s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Created reservations ['0bcbe0ad-03b9-4dc3-b053-6dba4073a191', '87e37670-ac90-4737-b6da-4e6b67f78eb8', '74900521-20f9-4972-8d67-c4bdbbd155c4', 'd7ff1f28-fee4-4f1d-8b00-8ee3a3d85284'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:07 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Delete snapshot completed successfully.
Apr 29 08:46:07 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-f24c808c-43a4-4439-be3e-95c8f30cec63 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-01b37f9e-5367-4ce9-81f2-b2c4d1bb1786-delete_snapshot" released by "delete_snapshot" :: held 3.493s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:08 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.info" returned: 0 in 0.673s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:08 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-9d60ebbb-12ad-453e-9d87-2012b8efc3fe tempest-CreateVolumesFromSnapshotTest-1435396197 None] Create snapshot completed successfully
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-eff7caf3-fd67-4298-ac9a-9834c168441e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-eff7caf3-fd67-4298-ac9a-9834c168441e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a933ffa-c1c1-4233-9b12-ed8f7fe9356d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:08 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:08 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:46:08 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:09 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.794s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:09 devstack sudo[93012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e
Apr 29 08:46:09 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (28bdf307-7d3b-4a2b-ab8b-79474f4ea76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f2116-3e6b-4ca8-be9e-df4176f2633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f2116-3e6b-4ca8-be9e-df4176f2633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410803459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842b8794-3535-4203-b18c-5e05ea6be98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:10Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da42056d-1f56-43b9-bcca-14fcb6936118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da42056d-1f56-43b9-bcca-14fcb6936118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f23fc83-38cf-44ca-a58d-db834c0351cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f23fc83-38cf-44ca-a58d-db834c0351cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842b8794-3535-4203-b18c-5e05ea6be98e', 'volume_name': 'volume-842b8794-3535-4203-b18c-5e05ea6be98e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb720b3-351b-4c0e-a13a-3d5d7d6555f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb720b3-351b-4c0e-a13a-3d5d7d6555f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a12c8f-5793-4890-90c1-11fd964ebc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:09 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume 842b8794-3535-4203-b18c-5e05ea6be98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842b8794-3535-4203-b18c-5e05ea6be98e', 'volume_size': 1}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:09 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1410803459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842b8794-3535-4203-b18c-5e05ea6be98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:10Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume 842b8794-3535-4203-b18c-5e05ea6be98e {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:10 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:10 devstack sudo[93014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e 1073741824
Apr 29 08:46:10 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (d576e815-9a85-45a3-9dd4-a023632f24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:10 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f2acd9-203b-443d-a4cd-8fff09ba034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-eff7caf3-fd67-4298-ac9a-9834c168441e" returned: 0 in 0.882s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f2acd9-203b-443d-a4cd-8fff09ba034b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917925774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab515be-875b-4739-a990-23f2f19efbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:10Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199671c8-95a2-49ee-aaa7-1a51c496b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199671c8-95a2-49ee-aaa7-1a51c496b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24665afb-893b-4af5-b1f5-1ef97f961d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24665afb-893b-4af5-b1f5-1ef97f961d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab515be-875b-4739-a990-23f2f19efbba', 'volume_name': 'volume-cab515be-875b-4739-a990-23f2f19efbba', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976f66c9-ddb2-49a5-9816-5c82c3a113c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976f66c9-ddb2-49a5-9816-5c82c3a113c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0563866-6629-4623-8bcf-83465c04f5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:10 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume cab515be-875b-4739-a990-23f2f19efbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab515be-875b-4739-a990-23f2f19efbba', 'volume_size': 1}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-eff7caf3-fd67-4298-ac9a-9834c168441e" released by "delete_volume" :: held 1.811s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Created reservations ['21c90039-4ec5-480e-bb6d-defe3376f76d', '8306f530-0866-4839-aaa5-5f53c960ee1b', 'f3df85a4-939c-4115-b1ba-73f7e2b5c803', '30f69fb3-341a-4bdc-935c-d1586ef1a09e'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:10 devstack sudo[93018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:10 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (996ac208-c42a-48b1-9eaf-431a86536465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:10 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d2957d-67c0-433e-ab45-dd6cbd7005ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d2957d-67c0-433e-ab45-dd6cbd7005ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451911276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e071afbf-74bb-485f-9c39-1084664a80c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:11Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccf25ea-d903-45bd-8f84-94a12bf8276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccf25ea-d903-45bd-8f84-94a12bf8276e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ace2f0-ec87-4187-b59a-802f127ca9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ace2f0-ec87-4187-b59a-802f127ca9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e071afbf-74bb-485f-9c39-1084664a80c7', 'volume_name': 'volume-e071afbf-74bb-485f-9c39-1084664a80c7', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1dd3f4-bf3a-44ff-8ccc-4140d8e6d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1dd3f4-bf3a-44ff-8ccc-4140d8e6d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b8011-3d9e-4f8f-8372-6adba3d1e610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume e071afbf-74bb-485f-9c39-1084664a80c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e071afbf-74bb-485f-9c39-1084664a80c7', 'volume_size': 1}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:11 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e 1073741824" returned: 0 in 1.552s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (908ace6d-ee3c-46fb-a11c-e800cd6cd044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0778ef-e2c3-41b6-b69f-ec0928720201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff0778ef-e2c3-41b6-b69f-ec0928720201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215638336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8118ec7c-f7ee-45bf-a846-b1ce0bf40347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f68c3d-7ed9-44f3-993f-78162403bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f68c3d-7ed9-44f3-993f-78162403bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b04f40a-26e0-4755-aa2f-6862fad93707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b04f40a-26e0-4755-aa2f-6862fad93707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8118ec7c-f7ee-45bf-a846-b1ce0bf40347', 'volume_name': 'volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa15059-1546-48d8-8f9d-c981d0487e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa15059-1546-48d8-8f9d-c981d0487e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72a7b2b-2649-4c72-bf91-1852dae3e480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:11 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume 8118ec7c-f7ee-45bf-a846-b1ce0bf40347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347', 'volume_size': 1}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:11 devstack sudo[93025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e
Apr 29 08:46:11 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:11 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.182s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:11 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Deleted volume successfully.
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:11 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (ba4187bc-38ea-4be3-a5fa-6d1948d0deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d315a9a3-7df8-4828-a9da-4f5d279ed574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d315a9a3-7df8-4828-a9da-4f5d279ed574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-852543015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ac20bf-0470-4a47-bd1e-246e5f1871ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820bc26-9a20-4d2d-92bd-5063f316917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820bc26-9a20-4d2d-92bd-5063f316917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3088f6d5-0e1c-46d6-a5e3-4525e20c6db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3088f6d5-0e1c-46d6-a5e3-4525e20c6db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'volume_name': 'volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1d6072-916e-48b0-91c2-9d9263580fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d1d6072-916e-48b0-91c2-9d9263580fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486ee8d7-dfce-4c16-82f9-49ec5932a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Volume b7ac20bf-0470-4a47-bd1e-246e5f1871ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'volume_size': 1}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-dd3c011b-1fee-43a7-a6dd-f495c38afdeb tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-eff7caf3-fd67-4298-ac9a-9834c168441e-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (6de186b4-aea4-47d1-aaee-d0914a5b90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcf40b-01fd-4681-a344-b2bedab8bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dcf40b-01fd-4681-a344-b2bedab8bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1234230569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37ab7f1-3153-4416-aa48-40f864a4a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddfea62-c83f-4b7e-ba86-234c61f9b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddfea62-c83f-4b7e-ba86-234c61f9b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36833112-6314-4736-bfaf-9923d57b7d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36833112-6314-4736-bfaf-9923d57b7d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c37ab7f1-3153-4416-aa48-40f864a4a17a', 'volume_name': 'volume-c37ab7f1-3153-4416-aa48-40f864a4a17a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3657df2c-87c3-489b-be15-822a5a25cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3657df2c-87c3-489b-be15-822a5a25cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e707f67-9b58-475a-9d7d-26e87388d352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume c37ab7f1-3153-4416-aa48-40f864a4a17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c37ab7f1-3153-4416-aa48-40f864a4a17a', 'volume_size': 1}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:12 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e" returned: 0 in 0.786s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (2487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.490s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917925774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab515be-875b-4739-a990-23f2f19efbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:10Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume cab515be-875b-4739-a990-23f2f19efbba {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:12 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a12c8f-5793-4890-90c1-11fd964ebc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842b8794-3535-4203-b18c-5e05ea6be98e', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack sudo[93028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba 1073741824
Apr 29 08:46:12 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feaaeaa-a4fd-43a1-aabd-dca7916ea670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:12 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-842b8794-3535-4203-b18c-5e05ea6be98e (842b8794-3535-4203-b18c-5e05ea6be98e): created successfully
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7feaaeaa-a4fd-43a1-aabd-dca7916ea670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:12 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (28bdf307-7d3b-4a2b-ab8b-79474f4ea76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:12 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2256954b-a00d-4091-8245-20a8e8baf271 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:46:13 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba 1073741824" returned: 0 in 0.897s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:13 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:13 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba
Apr 29 08:46:13 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:14 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba" returned: 0 in 0.708s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.071s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451911276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e071afbf-74bb-485f-9c39-1084664a80c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:11Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume e071afbf-74bb-485f-9c39-1084664a80c7 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:14 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:14 devstack sudo[93043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 1073741824
Apr 29 08:46:14 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0563866-6629-4623-8bcf-83465c04f5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab515be-875b-4739-a990-23f2f19efbba', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010350ee-f52a-4e68-b1f5-7a3c353285aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:14 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-cab515be-875b-4739-a990-23f2f19efbba (cab515be-875b-4739-a990-23f2f19efbba): created successfully
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010350ee-f52a-4e68-b1f5-7a3c353285aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:14 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (d576e815-9a85-45a3-9dd4-a023632f24ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:14 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-7a7e6929-ac33-443e-a193-554ace31400c tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:46:15 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 1073741824" returned: 0 in 0.847s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:15 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7
Apr 29 08:46:15 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:15 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7" returned: 0 in 0.649s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.048s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1215638336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8118ec7c-f7ee-45bf-a846-b1ce0bf40347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume 8118ec7c-f7ee-45bf-a846-b1ce0bf40347 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:15 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:15 devstack sudo[93052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 1073741824
Apr 29 08:46:15 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098b8011-3d9e-4f8f-8372-6adba3d1e610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e071afbf-74bb-485f-9c39-1084664a80c7', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb17dac-5781-4fb3-b3ea-770d8010cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=183,cinder:SELECT=136,cinder:INSERT=47,cinder:DELETE=19 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:46:15 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-e071afbf-74bb-485f-9c39-1084664a80c7 (e071afbf-74bb-485f-9c39-1084664a80c7): created successfully
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb17dac-5781-4fb3-b3ea-770d8010cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:15 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (996ac208-c42a-48b1-9eaf-431a86536465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:15 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0d63e3ff-bc50-4653-b089-dd580c95fc59 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:46:16 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 1073741824" returned: 0 in 0.896s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:SELECT=132,cinder:UPDATE=188,cinder:DELETE=17,cinder:INSERT=38 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:16 devstack sudo[93058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347
Apr 29 08:46:16 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:16 devstack sudo[93060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:16 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:17 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" returned: 0 in 0.743s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.352s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-852543015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ac20bf-0470-4a47-bd1e-246e5f1871ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Creating volume b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:17 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72a7b2b-2649-4c72-bf91-1852dae3e480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44cb3e-adb6-450d-9b23-0b97a263ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:17 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce 1073741824
Apr 29 08:46:17 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:17 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 (8118ec7c-f7ee-45bf-a846-b1ce0bf40347): created successfully
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44cb3e-adb6-450d-9b23-0b97a263ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (908ace6d-ee3c-46fb-a11c-e800cd6cd044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:17 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3606552e-5c25-47d5-bbe2-02659056e370 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:46:17 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.768s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:18 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce 1073741824" returned: 0 in 0.923s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:18 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:18 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:18 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:19 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.709s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.852s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1234230569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37ab7f1-3153-4416-aa48-40f864a4a17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d90e61b927c4869921cf8e6393cf230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:12Z,use_quota=True,user_id='6dd845efbf69428098ffcfa3f89e01be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Creating volume c37ab7f1-3153-4416-aa48-40f864a4a17a {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:19 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486ee8d7-dfce-4c16-82f9-49ec5932a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:19 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a 1073741824
Apr 29 08:46:19 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6d1de6-59b8-4515-8b1f-8683d30a754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:19 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Volume volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce (b7ac20bf-0470-4a47-bd1e-246e5f1871ce): created successfully
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6d1de6-59b8-4515-8b1f-8683d30a754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:19 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (ba4187bc-38ea-4be3-a5fa-6d1948d0deba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:19 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-2014dab8-fdd1-4aec-9b86-80589b20280a tempest-VolumeDependencyTests-2000884199 None] Created volume successfully.
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (f278f83b-68c1-43c2-92ea-0b2253f2a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63ab1e9-4358-4827-bd1d-6ad31484b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63ab1e9-4358-4827-bd1d-6ad31484b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-191728148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f546a39-fb12-4295-af6d-746d4cc59cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ec9e5dceba45f7a331c3629076a0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=b7ac20bf-0470-4a47-bd1e-246e5f1871ce,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:20Z,use_quota=True,user_id='381e05f956454018b5d3a37d43a1c416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e7e16f-d358-4cd7-a32f-1dcee0b4df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e7e16f-d358-4cd7-a32f-1dcee0b4df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8640a808-5441-4cc3-9109-c2fe58791134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8640a808-5441-4cc3-9109-c2fe58791134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f546a39-fb12-4295-af6d-746d4cc59cef', 'volume_name': 'volume-4f546a39-fb12-4295-af6d-746d4cc59cef', 'volume_size': 1, 'source_volid': 'b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342007b0-488a-4775-8b88-4fdfdbbc36d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342007b0-488a-4775-8b88-4fdfdbbc36d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1ccd62-0650-4bb2-a96a-59ecce879810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:20 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Volume 4f546a39-fb12-4295-af6d-746d4cc59cef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f546a39-fb12-4295-af6d-746d4cc59cef', 'volume_size': 1, 'source_volid': 'b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'source_volstatus': 'available'}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:20 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a 1073741824" returned: 0 in 1.159s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:20 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a
Apr 29 08:46:20 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:20 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a" returned: 0 in 0.641s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.746s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:20 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Cloning volume b7ac20bf-0470-4a47-bd1e-246e5f1871ce to volume 4f546a39-fb12-4295-af6d-746d4cc59cef
Apr 29 08:46:20 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e707f67-9b58-475a-9d7d-26e87388d352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37ab7f1-3153-4416-aa48-40f864a4a17a', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54a051-9441-47a2-8c5e-3736545a23f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:21 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Volume volume-c37ab7f1-3153-4416-aa48-40f864a4a17a (c37ab7f1-3153-4416-aa48-40f864a4a17a): created successfully
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b54a051-9441-47a2-8c5e-3736545a23f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Flow 'volume_create_manager' (6de186b4-aea4-47d1-aaee-d0914a5b90a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:21 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ddff4d3c-4837-4ebb-a396-499d8677a90f tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created volume successfully.
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Creating offline snapshot f0d505c8-1430-4a78-80b4-f9cfc1197755 of volume b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8228b9c-1951-4515-be80-899ebd22f403]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:21 devstack sudo[93083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:21 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:21 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.823s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:21 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:21 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 1G
Apr 29 08:46:21 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-c37ab7f1-3153-4416-aa48-40f864a4a17a-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-c37ab7f1-3153-4416-aa48-40f864a4a17a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-c37ab7f1-3153-4416-aa48-40f864a4a17a" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c37ab7f1-3153-4416-aa48-40f864a4a17a" acquired by "delete_volume" :: waited 0.033s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f508b9-163a-448f-b9ef-c8f5977ede48]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:22 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a
Apr 29 08:46:22 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:22 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 1G" returned: 0 in 1.012s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:22 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:22 devstack sudo[93096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:22 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:23 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a" returned: 0 in 0.885s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:23 devstack sudo[93101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a
Apr 29 08:46:23 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:23 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 0.838s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:23 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 is being set with open permissions: ugo+rw
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:23 devstack sudo[93107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:23 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:23 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c37ab7f1-3153-4416-aa48-40f864a4a17a" returned: 0 in 0.665s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c37ab7f1-3153-4416-aa48-40f864a4a17a" released by "delete_volume" :: held 1.660s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:23 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['36d1d514-43f9-4ced-b36a-f8093b1b2bef', 'c9ebbb4f-7cc2-46d1-9a65-364f6d4f2cd0', 'bc01b504-8b68-4a0c-ac8a-8f2a8d903a03', '0f8aec2f-ea0f-4a79-a4cd-2586452c3255'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:24 devstack sudo[93109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:24 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-8118ec7c-f7ee-45bf-a846-b1ce0bf40347-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:24 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 0.711s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-8118ec7c-f7ee-45bf-a846-b1ce0bf40347-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:24 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info
Apr 29 08:46:24 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" acquired by "delete_volume" :: waited 0.026s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3527133-4aaa-4322-bd7b-4d77d65aec37]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:24 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.787s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:24 devstack sudo[93114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:24 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:24 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:24 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-8f75ade2-93af-4f09-8dee-fc951db0a5f6 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-c37ab7f1-3153-4416-aa48-40f864a4a17a-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:25 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info" returned: 0 in 0.770s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:25 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info is being set with open permissions: ugo+rw
Apr 29 08:46:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:25 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info
Apr 29 08:46:25 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:25 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" returned: 0 in 1.093s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:25 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:25 devstack sudo[93123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347
Apr 29 08:46:25 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:25 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.info" returned: 0 in 0.693s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] snapshot: f0d505c8-1430-4a78-80b4-f9cfc1197755, volume: 4f546a39-fb12-4295-af6d-746d4cc59cef,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f38eb52-6599-4b0b-8a6b-a1ef236d3c0b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:26 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:26 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:26 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" returned: 0 in 0.731s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-8118ec7c-f7ee-45bf-a846-b1ce0bf40347" released by "delete_volume" :: held 1.885s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['7f51a2fa-41b3-4db6-849e-423b332f2341', 'c1597f99-a361-4583-a473-f7e0409ea618', '14a0eaa1-3b47-4b83-a261-692c9597736d', '714e32e0-1508-44a6-b4b4-883eefbd96f8'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-e071afbf-74bb-485f-9c39-1084664a80c7-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:26 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:26 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-e071afbf-74bb-485f-9c39-1084664a80c7-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-e071afbf-74bb-485f-9c39-1084664a80c7" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-e071afbf-74bb-485f-9c39-1084664a80c7" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f241006-7c68-4651-b4bc-cd77c4c43ceb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:26 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:27 devstack sudo[93133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7
Apr 29 08:46:27 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:27 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 1.087s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f8d67-9a9c-40ec-ab22-35dc9933fa14]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:27 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:27 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:27 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.900s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:27 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1cb618bb-aa5e-4c8f-a18f-2f5593092db8 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-8118ec7c-f7ee-45bf-a846-b1ce0bf40347-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:27 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7" returned: 0 in 0.922s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:27 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:27 devstack sudo[93144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7
Apr 29 08:46:27 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:28 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.963s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:28 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef
Apr 29 08:46:28 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:28 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-e071afbf-74bb-485f-9c39-1084664a80c7" returned: 0 in 0.802s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-e071afbf-74bb-485f-9c39-1084664a80c7" released by "delete_volume" :: held 1.806s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['ea338c2f-bfe5-40c6-9c38-0baa1966eeab', '569657b7-3864-47b3-8a46-6ec8a3eabcf8', '877d9a9a-9c2a-4e8a-9393-1c8678ea7ee8', 'cecfdc52-4c72-48e2-972c-49a68eb4fad5'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:28 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:28 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:28 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-cab515be-875b-4739-a990-23f2f19efbba-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-cab515be-875b-4739-a990-23f2f19efbba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-cab515be-875b-4739-a990-23f2f19efbba" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-cab515be-875b-4739-a990-23f2f19efbba" acquired by "delete_volume" :: waited 0.036s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf2a91c-6ccb-4c43-b80e-ebb442c5aea0]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:29 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:30 devstack sudo[93163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba
Apr 29 08:46:30 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:30 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:30 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.412s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:30 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:30 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:30 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5d01a291-e121-4e99-affe-713d6a9034d0 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-e071afbf-74bb-485f-9c39-1084664a80c7-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:31 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba" returned: 0 in 2.078s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:31 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:31 devstack sudo[93170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba
Apr 29 08:46:31 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:33 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:33 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-cab515be-875b-4739-a990-23f2f19efbba" returned: 0 in 2.025s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:33 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-cab515be-875b-4739-a990-23f2f19efbba" released by "delete_volume" :: held 4.223s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:33 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['068f8e60-9ccf-4d4f-ba6f-e51d34fcab62', 'c35f6a82-3034-4081-9221-a3a637c53522', '803d799d-d269-4d28-b7dd-88430248c0c2', '65d61ef2-4444-4725-8ced-ea0ceb004463'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:34 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:34 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-842b8794-3535-4203-b18c-5e05ea6be98e-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-842b8794-3535-4203-b18c-5e05ea6be98e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-842b8794-3535-4203-b18c-5e05ea6be98e" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-842b8794-3535-4203-b18c-5e05ea6be98e" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd3773f-3d31-4713-b636-8879a7f02c53]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:34 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:34 devstack sudo[93175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e
Apr 29 08:46:34 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:35 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef" returned: 0 in 7.105s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca85cc-a515-482a-be84-1073dbdf66ae]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:35 devstack sudo[93178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:35 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:35 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 1.374s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:35 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-5ae6703e-2da3-4a9f-8802-6c095ec2b422 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-cab515be-875b-4739-a990-23f2f19efbba-delete_volume" released by "delete_volume" :: held 6.279s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:35 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e" returned: 0 in 1.343s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:35 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:35 devstack sudo[93184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e
Apr 29 08:46:35 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:36 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 1.119s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:46:36 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Converted 1024.00 MB image at 144.09 MB/s
Apr 29 08:46:36 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef is being set with open permissions: ugo+rw
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:36 devstack sudo[93189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef
Apr 29 08:46:36 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:36 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-842b8794-3535-4203-b18c-5e05ea6be98e" returned: 0 in 0.848s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-842b8794-3535-4203-b18c-5e05ea6be98e" released by "delete_volume" :: held 2.292s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['1da24cb1-78b5-44f1-93d0-327622fb8636', 'fd7d0de3-39f4-4095-8fcb-e7c94850ca6f', 'db6ed436-cf7a-44df-ab9e-943ddee5df0a', '81f2ad08-1b50-4479-8074-b7499da6e727'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:36 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:36 devstack sudo[93192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:36 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:37 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef" returned: 0 in 0.686s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" released by "_copy_volume_from_snapshot" :: held 11.098s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-f0d505c8-1430-4a78-80b4-f9cfc1197755" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-f0d505c8-1430-4a78-80b4-f9cfc1197755" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Deleting offline snapshot f0d505c8-1430-4a78-80b4-f9cfc1197755 of volume b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] snapshot_file for this snap is: volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5eeafb-6004-439b-a436-d65ec0db3dd3]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:37 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:37 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Flow 'volume_create_manager' (e61e33f5-fb7e-42fc-8104-d65319ddb4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e66c8c-84d9-41ca-a79c-4ab7de05a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e66c8c-84d9-41ca-a79c-4ab7de05a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-830303252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71064e54-54eb-4173-8ad8-2444c3317366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb45b931f54407186508748799a93b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:37Z,use_quota=True,user_id='253fb5c234c3443aa595320da668eb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74ed869-cb34-4450-8ead-dad078775d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74ed869-cb34-4450-8ead-dad078775d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd09e57-e7f4-437f-bdc8-d33242007ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd09e57-e7f4-437f-bdc8-d33242007ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71064e54-54eb-4173-8ad8-2444c3317366', 'volume_name': 'volume-71064e54-54eb-4173-8ad8-2444c3317366', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d28a6b2-0f2f-4578-a1e5-97ca9fe4ceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d28a6b2-0f2f-4578-a1e5-97ca9fe4ceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f118a4-bf77-414a-8f4f-df6cf94c05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:37 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Volume 71064e54-54eb-4173-8ad8-2444c3317366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71064e54-54eb-4173-8ad8-2444c3317366', 'volume_size': 1}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:37 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.667s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:37 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-e32ca90e-8d40-4e01-9aa0-39c84791d2eb tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-842b8794-3535-4203-b18c-5e05ea6be98e-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-d64bd62a-6309-426b-b14e-6d10fb279c73-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-d64bd62a-6309-426b-b14e-6d10fb279c73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-d64bd62a-6309-426b-b14e-6d10fb279c73" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-d64bd62a-6309-426b-b14e-6d10fb279c73" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleting offline snapshot d64bd62a-6309-426b-b14e-6d10fb279c73 of volume c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] snapshot_file for this snap is: volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[936fba6d-b8b6-4668-a18f-3b966496bee8]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:37 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:38 devstack sudo[93200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73
Apr 29 08:46:38 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:38 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 0.820s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce52a2-87bb-4370-b134-f40617e8a8df]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:38 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:38 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:38 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73" returned: 0 in 0.768s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1cf8c0-fd3b-45fe-a184-f63133dcf80c]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:38 devstack sudo[93209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd
Apr 29 08:46:38 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:38 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.757s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:38 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:38 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:38 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:39 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" returned: 0 in 0.779s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:39 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73
Apr 29 08:46:39 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:39 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 0.755s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:39 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:39 devstack sudo[93223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755
Apr 29 08:46:39 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:40 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73" returned: 0 in 0.719s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:40 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73
Apr 29 08:46:40 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:40 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce.f0d505c8-1430-4a78-80b4-f9cfc1197755" returned: 0 in 0.653s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-f0d505c8-1430-4a78-80b4-f9cfc1197755" released by "_delete_snapshot" :: held 3.100s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.331s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.837s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76147a297650>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-830303252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71064e54-54eb-4173-8ad8-2444c3317366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb45b931f54407186508748799a93b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:37Z,use_quota=True,user_id='253fb5c234c3443aa595320da668eb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)}" {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Creating volume 71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:40 devstack cinder-volume[84102]: INFO cinder.volume.drivers.remotefs [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] casted to osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 1073741824 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1ccd62-0650-4bb2-a96a-59ecce879810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f546a39-fb12-4295-af6d-746d4cc59cef', 'volume_size': 1, 'source_volid': 'b7ac20bf-0470-4a47-bd1e-246e5f1871ce', 'source_volstatus': 'available'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:40 devstack sudo[93231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 1073741824
Apr 29 08:46:40 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6869bc6c-0b73-46f8-98d8-ab8d5c92389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:40 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Volume volume-4f546a39-fb12-4295-af6d-746d4cc59cef (4f546a39-fb12-4295-af6d-746d4cc59cef): created successfully
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6869bc6c-0b73-46f8-98d8-ab8d5c92389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Flow 'volume_create_manager' (f278f83b-68c1-43c2-92ea-0b2253f2a286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:40 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-270dbf69-a4a8-4d10-a923-6be3de916f68 tempest-VolumeDependencyTests-2000884199 None] Created volume successfully.
Apr 29 08:46:40 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd.d64bd62a-6309-426b-b14e-6d10fb279c73" returned: 0 in 0.722s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-d64bd62a-6309-426b-b14e-6d10fb279c73" released by "_delete_snapshot" :: held 3.106s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:40 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" released by "delete_snapshot" :: held 3.129s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['a4960fe3-b5f7-4333-b2dd-387d790b03eb', '5bab3ccb-01e6-4482-9ebd-54074b7a5f97', '99b89dec-0b55-412c-a9b2-9db82086a548', 'e10c6852-d8a6-4947-aed6-18020e3092e8'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:41 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Delete snapshot completed successfully.
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fc896498-dde5-4f74-a408-2d4cda4f4715 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-d64bd62a-6309-426b-b14e-6d10fb279c73-delete_snapshot" released by "delete_snapshot" :: held 3.270s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:41 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 1073741824" returned: 0 in 0.897s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:41 devstack sudo[93239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:46:41 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-b7ac20bf-0470-4a47-bd1e-246e5f1871ce-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-b7ac20bf-0470-4a47-bd1e-246e5f1871ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6973f92-ab3a-4585-9e85-3022e2a1016d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:41 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:41 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:41 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.615s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'} {{(pid=84102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f118a4-bf77-414a-8f4f-df6cf94c05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71064e54-54eb-4173-8ad8-2444c3317366', 'volume_size': 1}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75eaf6ee-d24b-473a-8434-919155adf1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:41 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Volume volume-71064e54-54eb-4173-8ad8-2444c3317366 (71064e54-54eb-4173-8ad8-2444c3317366): created successfully
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75eaf6ee-d24b-473a-8434-919155adf1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:41 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Flow 'volume_create_manager' (e61e33f5-fb7e-42fc-8104-d65319ddb4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:41 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-e98d1ab3-9a74-4261-9bce-9d5ec7a759aa tempest-SnapshotDependencyTests-913148235 None] Created volume successfully.
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-c8e2dd26-bf1f-4e02-8f76-3d25355095dd-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-c8e2dd26-bf1f-4e02-8f76-3d25355095dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb68033-72f8-40ef-8efa-7ea6c8cf2a7b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:42 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd
Apr 29 08:46:42 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:42 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.805s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:42 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce
Apr 29 08:46:42 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:42 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" returned: 0 in 0.745s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:42 devstack sudo[93256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd
Apr 29 08:46:42 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:42 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Creating offline snapshot 98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 of volume 71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 29 08:46:43 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" returned: 0 in 0.656s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c753616-b4cc-4ab0-8a29-e3bffc005bdb]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-b7ac20bf-0470-4a47-bd1e-246e5f1871ce" released by "delete_volume" :: held 1.544s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Created reservations ['1f143930-1282-44b0-bdcd-a4027811ea43', '98d1e1ee-505c-441e-9621-7fef06f4df62', 'cbfa087d-58f4-435f-adea-b8899a3da95f', 'cca3340d-cf98-4ab2-b30f-ae261240f4a9'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:43 devstack sudo[93258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:46:43 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack sudo[93260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:43 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-4f546a39-fb12-4295-af6d-746d4cc59cef-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-4f546a39-fb12-4295-af6d-746d4cc59cef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:43 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" returned: 0 in 0.857s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" acquired by "delete_volume" :: waited 0.042s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-quobyte-c8e2dd26-bf1f-4e02-8f76-3d25355095dd" released by "delete_volume" :: held 1.704s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b2e45-53a0-491c-a10a-16602f3f9d78]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Created reservations ['2a1031de-8d0a-4b2b-ba51-27ccda235ba0', '55c8bd83-05c9-4820-9428-22d68944afcf', '98fa7959-efd2-4dbc-96af-befcc0689de3', '61bd17d5-4e84-40c4-9b34-dc567b1794c1'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:43 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[93266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef
Apr 29 08:46:44 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.993s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 1G {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.769s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Deleted volume successfully.
Apr 29 08:46:44 devstack sudo[93272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 1G
Apr 29 08:46:44 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-ecfeb9bf-78ce-4c20-8c3c-c9822032f86c tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-b7ac20bf-0470-4a47-bd1e-246e5f1871ce-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:44 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef" returned: 0 in 0.940s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.807s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:44 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Deleted volume successfully.
Apr 29 08:46:44 devstack sudo[93282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef
Apr 29 08:46:44 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3311973f-343a-4754-84ab-fbe780f34671 tempest-CreateVolumesFromSnapshotTest-1435396197 None] Lock "cinder-c8e2dd26-bf1f-4e02-8f76-3d25355095dd-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:44 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 1G" returned: 0 in 0.902s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:44 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71064e54-54eb-4173-8ad8-2444c3317366 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:44 devstack sudo[93284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71064e54-54eb-4173-8ad8-2444c3317366 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:46:44 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:45 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-4f546a39-fb12-4295-af6d-746d4cc59cef" returned: 0 in 0.737s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-4f546a39-fb12-4295-af6d-746d4cc59cef" released by "delete_volume" :: held 1.736s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Created reservations ['f53ab2b1-24c4-4012-9b17-db21afa57be0', '6f43942a-3559-430b-a270-dfd5ae4b0220', '58971f1b-58cb-459f-876d-5a81d8a52320', 'aeaf2a88-7571-497c-8084-71cb449f2c6c'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:45 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71064e54-54eb-4173-8ad8-2444c3317366 -F qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.780s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:45 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 is being set with open permissions: ugo+rw
Apr 29 08:46:45 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:45 devstack sudo[93290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:45 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:45 devstack sudo[93291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:46:45 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-7f50fd4b-e3b0-43db-8282-2e4b46752608-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-7f50fd4b-e3b0-43db-8282-2e4b46752608-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" acquired by "delete_volume" :: waited 0.032s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a77405-76c5-41c8-84f9-d800f7338e1f]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:46 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608
Apr 29 08:46:46 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:46 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.747s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:46 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Deleted volume successfully.
Apr 29 08:46:46 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.757s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-0b04acab-3b2d-43c8-b49f-c8a79fb65593 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-4f546a39-fb12-4295-af6d-746d4cc59cef-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:46 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:46 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info
Apr 29 08:46:46 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:47 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608" returned: 0 in 0.754s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:47 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608
Apr 29 08:46:47 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:47 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info" returned: 0 in 0.621s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info is being set with open permissions: ugo+rw
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:47 devstack sudo[93306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info
Apr 29 08:46:47 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:47 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-7f50fd4b-e3b0-43db-8282-2e4b46752608" returned: 0 in 0.659s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-quobyte-7f50fd4b-e3b0-43db-8282-2e4b46752608" released by "delete_volume" :: held 1.481s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Created reservations ['382b2d80-d0d3-446e-80af-a100a4824189', 'c9cbca8e-e45e-4cb5-bce1-e25a6db31dc4', '656e7446-9de8-48b1-9eb0-2b0b39a200d3', 'dd228e9b-f4a8-46d6-91a4-08630f11172f'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:46:47 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.info" returned: 0 in 0.658s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.809s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:47 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-5dd9ca29-568f-4bfa-aefc-144bfed8f644 tempest-SnapshotDependencyTests-913148235 None] Create snapshot completed successfully
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:47 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:47 devstack sudo[93310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:46:47 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:48 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:48 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.684s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:48 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:46:48 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Deleted volume successfully.
Apr 29 08:46:48 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-fe4daefc-9b3f-4051-8a7c-7d3da410a148 tempest-VolumeDependencyTests-2000884199 None] Lock "cinder-7f50fd4b-e3b0-43db-8282-2e4b46752608-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:48 devstack cinder-volume[84102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Flow 'volume_create_manager' (a32b13e7-6a16-40f4-ba36-f2b14188ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030a1233-0141-4f34-83fd-562b9581e2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030a1233-0141-4f34-83fd-562b9581e2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a1492a-3ea6-4eda-a4f4-3a3328df52f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fb45b931f54407186508748799a93b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98eb1a65-b38a-4aa2-b408-d59ac7c4fa62,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T06:46:49Z,use_quota=True,user_id='253fb5c234c3443aa595320da668eb01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba796c67-53fa-4788-80c1-d398765c312e),volume_type_id=ba796c67-53fa-4788-80c1-d398765c312e)' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bb434d-bd8b-43d2-bf26-b604b319d942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bb434d-bd8b-43d2-bf26-b604b319d942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453e01-3759-4cd2-ad01-77d76087cd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f453e01-3759-4cd2-ad01-77d76087cd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9a1492a-3ea6-4eda-a4f4-3a3328df52f5', 'volume_name': 'volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5', 'volume_size': 1, 'snapshot_id': '98eb1a65-b38a-4aa2-b408-d59ac7c4fa62'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341e38f3-5a60-44a5-885d-3a8407238323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341e38f3-5a60-44a5-885d-3a8407238323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e30daa-6121-492a-ab4f-595e52950e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:49 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Volume b9a1492a-3ea6-4eda-a4f4-3a3328df52f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5', 'volume_size': 1, 'snapshot_id': '98eb1a65-b38a-4aa2-b408-d59ac7c4fa62'}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" by "_create_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Creating volume b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 from snapshot 98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Selected osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336 as target Quobyte volume. {{(pid=84102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" by "_copy_volume_from_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] snapshot: 98eb1a65-b38a-4aa2-b408-d59ac7c4fa62, volume: b9a1492a-3ea6-4eda-a4f4-3a3328df52f5,  {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c51ba7f-16a4-4153-bcf9-840173e40d7d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:49 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:49 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:46:49 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:50 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.858s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71064e54-54eb-4173-8ad8-2444c3317366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Creating direct copy from snapshot {{(pid=84102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cda58e-d017-4722-b212-4bf839cd2a1d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:50 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:46:50 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:50 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.749s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG cinder.utils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Path /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 not found in is_blk_device check {{(pid=84102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 08:46:50 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:50 devstack sudo[93326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5
Apr 29 08:46:50 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:55 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" returned: 0 in 4.999s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:55 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[977271e9-b6ff-476e-99fb-0a6cbbb4f00d]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:55 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:56 devstack sudo[93342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:46:56 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:56 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.886s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:56 devstack cinder-volume[84102]: DEBUG cinder.image.image_utils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 {{(pid=84102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 08:46:56 devstack cinder-volume[84102]: INFO cinder.image.image_utils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Converted 1024.00 MB image at 204.80 MB/s
Apr 29 08:46:56 devstack cinder-volume[84102]: WARNING cinder.volume.drivers.remotefs [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 is being set with open permissions: ugo+rw
Apr 29 08:46:56 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:56 devstack sudo[93347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5
Apr 29 08:46:56 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:57 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" returned: 0 in 0.619s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" released by "_copy_volume_from_snapshot" :: held 8.266s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" released by "_create_volume_from_snapshot" :: held 8.318s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.339s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e30daa-6121-492a-ab4f-595e52950e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5', 'volume_size': 1, 'snapshot_id': '98eb1a65-b38a-4aa2-b408-d59ac7c4fa62'}' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3567d2-554d-401a-a521-de56ff5416ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 08:46:57 devstack cinder-volume[84102]: INFO cinder.volume.flows.manager.create_volume [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Volume volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 (b9a1492a-3ea6-4eda-a4f4-3a3328df52f5): created successfully
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3567d2-554d-401a-a521-de56ff5416ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84102) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 08:46:57 devstack cinder-volume[84102]: DEBUG cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Flow 'volume_create_manager' (a32b13e7-6a16-40f4-ba36-f2b14188ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84102) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 08:46:57 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-3a0ebe4a-665a-4b64-8e3c-49302748cbad tempest-SnapshotDependencyTests-913148235 None] Created volume successfully.
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-delete_snapshot" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" by "delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" by "_delete_snapshot" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Deleting offline snapshot 98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 of volume 71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] snapshot_file for this snap is: volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[328467e4-4dcc-4d56-bab3-aecc8cad4a6b]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:58 devstack sudo[93350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:46:58 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:58 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.713s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.remotefs [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71064e54-54eb-4173-8ad8-2444c3317366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1e2ac-aade-455b-9147-383fe4fa7bc4]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:46:58 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:58 devstack sudo[93355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:46:58 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:46:59 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root
Apr 29 08:46:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.694s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:46:59 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:46:59 devstack sudo[93360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:46:59 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:00 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.665s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:00 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62
Apr 29 08:47:00 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:00 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366.98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" returned: 0 in 0.593s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62" released by "_delete_snapshot" :: held 2.780s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" released by "delete_snapshot" :: held 2.804s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Created reservations ['186515b3-0c0f-4131-952c-2583b2ea9ff4', '99d01e68-e9fb-4194-81bd-8ac9291ba20a', 'e21a1d4b-4e65-468a-b19d-ea60aaf86a0c', 'e3b1b27c-f3f5-4cde-a573-7a167cd950dc'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:00 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Delete snapshot completed successfully.
Apr 29 08:47:00 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-b9ff19b6-87ef-4408-a04a-0e7182370327 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-98eb1a65-b38a-4aa2-b408-d59ac7c4fa62-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-71064e54-54eb-4173-8ad8-2444c3317366-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-71064e54-54eb-4173-8ad8-2444c3317366-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" acquired by "delete_volume" :: waited 0.013s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8e465-5b3c-4d73-b813-86ca25525062]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:01 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:47:01 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:01 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.685s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:01 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:02 devstack sudo[93410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366
Apr 29 08:47:02 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:02 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-71064e54-54eb-4173-8ad8-2444c3317366" returned: 0 in 0.586s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-71064e54-54eb-4173-8ad8-2444c3317366" released by "delete_volume" :: held 1.328s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Created reservations ['d528c6df-7ad8-4d95-8dec-15831144dd27', '5f0d0f2e-098c-463c-8ce5-9d70049c8a9d', '5d248e3a-e791-419b-9cae-ef6f734b26f6', '0be0f2df-69c7-4586-9b19-da41c936048d'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:02 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:02 devstack sudo[93413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:47:02 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:03 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.591s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:03 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Deleted volume successfully.
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-815c6c3f-ff5f-493a-a2a5-f222715cf630 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-71064e54-54eb-4173-8ad8-2444c3317366-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5-delete_volume" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" by "delete_volume" {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" acquired by "delete_volume" :: waited 0.021s {{(pid=84102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0078477d-79c2-4f8a-8df4-0b8e2259daff]: (4, 'qcow2') {{(pid=85283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 08:47:03 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:03 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5
Apr 29 08:47:03 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:04 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" returned: 0 in 0.772s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:04 devstack sudo[93421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5
Apr 29 08:47:04 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:04 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:04 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58/volume-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" returned: 0 in 0.610s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:04 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-quobyte-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5" released by "delete_volume" :: held 1.435s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG cinder.quota [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Created reservations ['58869f90-6008-4a30-a153-ad1f08d37bb8', 'b6affaf7-132c-47b5-8684-fec45c0d78f0', '81d3599e-8b4d-4896-9b69-b8981fbd28d0', '95ea24fa-38d6-402a-9834-d97ac11796af'] {{(pid=84102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:05 devstack sudo[93424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:47:05 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:05 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.617s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 08:47:05 devstack cinder-volume[84102]: INFO cinder.volume.manager [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Deleted volume successfully.
Apr 29 08:47:05 devstack cinder-volume[84102]: DEBUG cinder.coordination [None req-1b4ce6a8-2a0f-4843-ab9b-bd239e481f77 tempest-SnapshotDependencyTests-913148235 None] Lock "cinder-b9a1492a-3ea6-4eda-a4f4-3a3328df52f5-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=84102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 08:47:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=116,cinder:SELECT=78,cinder:INSERT=31,cinder:DELETE=6 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:47:15 devstack cinder-volume[84102]: DEBUG dbcounter [-] [84102] Writing DB stats cinder:UPDATE=119,cinder:SELECT=85,cinder:INSERT=29,cinder:DELETE=12 {{(pid=84102) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG oslo_service.periodic_task [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84102) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336': None} {{(pid=84102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG cinder.volume.drivers.quobyte [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c95d7843-a9e6-46aa-bebf-b258d127a336'] {{(pid=84102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.lockutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84102) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 08:47:16 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58 {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 08:47:16 devstack sudo[93443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58
Apr 29 08:47:16 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 08:47:17 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root
Apr 29 08:47:17 devstack cinder-volume[84102]: DEBUG oslo_concurrency.processutils [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff381924017bb6aadf2f90de6fc87a58" returned: 0 in 0.629s {{(pid=84102) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 08:47:17 devstack cinder-volume[84102]: DEBUG cinder.manager [None req-13af1131-9ab4-46d4-baa0-873833567883 None None] Notifying Schedulers of capabilities ... {{(pid=84102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}